Turning any tokenizer into a greedy one

2 stephantul 1 8/10/2025, 6:17:08 AM stephantul.github.io ↗

Comments (1)

stephantul · 2d ago
I recently did some work on making tokenizers greedy.