📈 Leaky ReLU Visualizer
Same graph as ReLU — but the negative side gets a slight downward tilt instead of a hard floor.
📋 How To Use This Lab
Drag the
yellow handle
into negative territory
→
the output is small and negative, NOT zero.
Drag the
Negative Slope
slider
→
watch the tilt of the negative-side line change live.
Set the slope near 0.01
→
it looks almost flat, just like regular ReLU.
Set the slope near 0.5
→
the negative side becomes a much steeper, more generous leak.
x = 2.00
LeakyReLU(x) = 2.00
Negative Slope:
0.10
◀ Previous
Next ▶
Auto Run ▶▶
↺ Reset
📈 LEAKY
Drag into negative territory — I still let a small signal through instead of going completely flat.
🧑🏫 PROF. TORCH
LeakyReLU(x) = x if x≥0, else slope×x — that tiny leak keeps the gradient alive even for negative inputs.