Video lesson 1
Building micrograd
Build a tiny automatic-differentiation engine from scratch, the same idea behind PyTorch, then build and train a small neural network on top of it. Two guided projects: first the autograd engine, then the neural net + training loop.
Automatic differentiationComputation graphBackpropagationChain ruleReverse-mode autodiffGradients