Skip to content
hackertubeai

Welch Labs

AI can't cross this line and we don't know why.

About this video

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

neural networksdeep learning

Keep your curiosity going.

A few more ideas from the same corner of the archive.

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

But what is a neural network? | Deep learning chapter 1

3Blue1Brown

A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt

Enthought

How Self-Driving Cars will Destroy Cities (and what to do about it)

Not Just Bikes