Neural Ninjas · Knowledge Distillation
Teacher-Student Academy 🎓
The teacher doesn't just give the right answer. It hands over its whole way of thinking.
🧑🏫
Prof. Mega
340M parameters · knows everything
…
🧒
Tiny
5M parameters · knows nothing (yet)
…
Click "Next Step" — class is about to begin.