Skip to content
hackertubeai

Yannic Kilcher

Attention Is All You Need

About this video

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

deep learning

Keep your curiosity going.

A few more ideas from the same corner of the archive.

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy

But what is a neural network? | Deep learning chapter 1

3Blue1Brown

A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt

Enthought

How Self-Driving Cars will Destroy Cities (and what to do about it)

Not Just Bikes