Words are tokens and tokens are words
So today on my YouTube feed I had a video explaining vibe coding and how the models count tokens, which up to this point I had assumed there was 0 math behind it and just a wild bit thinking and an arbitrary number picked, but I learned today though that models (Claude, Gemini, etc …) consider 1 token to be 3/4 of a word? Is that right? Did I have a fever dream.
Posted Feb 26, 2026, 7:57 AM UTC
11