Skip to content

suckerpinch

GradIEEEnt half decent: The hidden power of imprecise lines

About this video

Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity needed to build a neural network.

neural networks