Neural Networks: Zero to Hero · Lesson 2

Building makemore: bigrams

Video lesson 2

Building makemore: bigrams

Build your first language model: a character-level bigram model that reads 32,033 real names and invents new ones. First by counting, then as a neural network trained by gradient descent that converges to the same answer. Two guided projects: the counting model, then the neural version.

Language modelingBigramsProbability distributionsPyTorch tensorsBroadcastingSampling