Neural Ninjas · BERT vs GPT
BERT the Detective 🕵️
GPT writes forward, never peeking ahead. BERT reads the whole room before saying a word.
🕵️
BERT
reads both directions · never writes a word
…
❓
The Blank
[MASK] · waiting to be identified
…
auto-advancing every 3.2s
Click "Next Step" or press Autorun — a word has gone missing, and BERT is on the case.
🔬 BERT vs GPT — same sentence, opposite eyesight
Both models look at "The cat sat on the ___" at the exact same moment. Watch how differently they're allowed to look.
BERT — sees every direction (encoder)
GPT — sees only the past (decoder)
blocked / not allowed