Neural Ninjas · Self vs Cross Attention
The Translation Booth 🎧
One room talks to itself. The other reaches across the glass.
🎧
The Interpreter
runs both kinds of attention, live
…
🐱
"Chats"
the French word being born
…
Click "Next Step" — the booth is live, and translation is about to begin.
🔬 Self-Attention vs Cross-Attention — side by side
Same booth, same moment. Watch WHERE the arrows are allowed to go.
Self-attention — arrows stay inside ONE sentence
Cross-attention — arrows reach into the OTHER sentence