I've never really considered how models treat languages. Would these all be siloed or are they made equivalent at tokenization into one model? Anyone know?
hunglee2 · 1d ago
great to see this - we need multi-polarity in AI, maybe even multi-polarity in AGI.
I've never really considered how models treat languages. Would these all be siloed or are they made equivalent at tokenization into one model? Anyone know?