Decasing Transformers for Fun

Comments (1)

stephantul · 13h ago

Hello!

I recently did some experiments in decasing models. I noticed our users not using casing at all, while the base models we use tend to be cased. So I investigated, and found a nice way to decase transformers tokenizers and make them lowercase internally, which I call decasing. I wrote a blog about it!

Terence Tao weighs in on the suspension of UCLA grants (mathstodon.xyz)

Ladybird Browser July Update (ladybird.org)

Cerebras Code (cerebras.ai)

Hardening mode for the compiler (discourse.llvm.org)

Coffeematic PC – A coffee maker computer that pumps hot coffee to the CPU (dougmacdowell.com)

Weather Model based on ADS-B (obrhubr.org)

JavaScript retro sound effects generator (github.grumdrig.com)

Robert Wilson has died (theartnewspaper.com)

At 17, Hannah Cairo solved a major math mystery (quantamagazine.org)

I couldn't submit a PR, so I got hired and fixed it myself (skeptrune.com)

Why leather is best motorbike protection – whilst being dragged along concrete (youtube.com)

Ethersync: Peer-to-peer collaborative editing of local text files (github.com)

Ask HN: Who is hiring? (August 2025)

The Rickover Corpus: A digital archive of Admiral Rickover's speeches and memos (rickovercorpus.org)

Ferroelectric Helps Break Transistor Limits (spectrum.ieee.org)

Yearly Organiser (neatnik.net)

Native Sparse Attention (aclanthology.org)

Does the Bitter Lesson Have Limits? (dbreunig.com)

Anthropic revokes OpenAI's access to Claude (wired.com)

Researchers map where solar energy delivers the biggest climate payoff (rutgers.edu)

Launch HN: Societies.io (YC W25) – AI simulations of your target audience

Show HN: Draw a fish and watch it swim with the others (drawafish.com)

Replacing tmux in my dev workflow (bower.sh)

Microsoft is open sourcing Windows 11's UI framework (neowin.net)

The tradeoff between human and AI context (softwaredoug.com)

Ask HN: Who wants to be hired? (August 2025)

Ergonomic keyboarding with the Svalboard: a half-year retrospective (twey.io)

Our Farewell from Google Play (secuso.aifb.kit.edu)

Twentyseven 1.0 (blog.poisson.chat)

Make Your Own Backup System – Part 2: Forging the FreeBSD Backup Stronghold (it-notes.dragas.net)

Self-Signed JWTs (selfref.com)

Google shifts goo.gl policy: Inactive links deactivated, active links preserved (blog.google)

Sources of Truth (cutlefish.substack.com)

Gemini 2.5 Deep Think (blog.google)

Deep Agents (blog.langchain.com)

How Hyper built a 1M-accurate indoor GPS (andrewhart.me)

The AI age is the "age of no consent" (productpicnic.beehiiv.com)

Coverage Cat (YC S22) Is Hiring a Senior, Staff, or Principal Engineer (coveragecat.com)

Supporting the BEAM community with free CI/CD security audits (erlang-solutions.com)

Show HN: TraceRoot – Open-source agentic debugging for distributed services (github.com)

A DH106 1A Comet has been restored at the de Havilland Aircraft Museum (cnn.com)

What's Not to Like? (theamericanscholar.org)

Fast (2019) (patrickcollison.com)

Build an AI telephony agent for inbound and outbound calls (github.com)

Pseudo, a Common Lisp macro for pseudocode expressions (funcall.blogspot.com)

Peak Energy just shipped the US's first grid-scale sodium-ion battery (electrek.co)

Show HN: Print the daily weather forecast on a thermal receipt printer (github.com)

OpenAI raises $8.3B at $300B valuation (nytimes.com)

Show HN: An interactive dashboard to explore NYC rentals data (leaseswap.nyc)

Corporation for Public Broadcasting ceasing operations (cpb.org)

Decasing Transformers for Fun

Comments (1)