Skip to content
hackertubeai

3Blue1Brown

Attention in transformers, step-by-step | Deep Learning Chapter 6

About this video

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

deep learning

Keep your curiosity going.

A few more ideas from the same corner of the archive.

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

But what is a neural network? | Deep learning chapter 1

3Blue1Brown

A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt

Enthought

How Self-Driving Cars will Destroy Cities (and what to do about it)

Not Just Bikes