Neural Ninjas Β· How LLMs Actually Work
LLMs Don't Understand β They Tokenize and Compute
Same sentence, two realities. Toggle, tap, and drag to see which one is true.
π¬ "Your LLM doesn't understand your question. It computes a statistically plausible answer. The magic isn't consciousness β it's math at scale."
Same sentence. Completely different reality.
Tap a word for what the model actually sees
Tap any word above to see what the model actually stores for it.
| What beginners think | What actually happens |
| π§ "It understands my question" | π It maps tokens to training patterns |
| π "It reads and comprehends" | π’ It processes numerical vectors |
| π¬ "It has reasoning" | π² It predicts the most probable next token |
Watch a sentence stop being words
Tokenize β Embed β Process β Decode
At no point did the model "understand" β it just computed.
What this showsPress "Run pipeline" and watch words stop being words.
It's not thinking β it's sampling
Drag temperature, then sample the next token
"The cat sat on the ___"
What this showsLow temperature always picks "mat." High temperature spreads the odds β the model isn't more "creative," the sampling is just less certain.