🧗 Gradient Clipping Visualizer

A glass ceiling stops exploding gradients from flinging your model into space.

📋 How To Use This Lab
  1. Press 🔥 Gradient Spike Generator → watch a huge gradient try to fling the ball off the landscape.
  2. Lower the Clip Threshold slider → the red "glass ceiling" circle shrinks — press Spike again and it gets sheared safely.
  3. Flip Show Original Direction → a ghost arrow shows the direction only was preserved, magnitude was capped.
  4. Try ▶ Auto-Training with the threshold set very low → watch the ball get stuck, unable to climb the hill.
Loss = 1.480
‖grad‖ = 0.450
Training
Loss Landscape Gradient Vector + Glass Ceiling Live Gradient Norm Gauge
Clipped Only
Show Original Direction
🧗 KLIPPress Next Step for normal training, or hit the Spike button to see what an exploding gradient looks like.
🧑‍🏫 PROF. TORCHclip_grad_norm_ rescales the gradient so its norm never exceeds max_norm — direction stays identical, only magnitude shrinks.