Neural Networks: Zero to Hero · Lesson 1

Building micrograd

Video lesson 1

Building micrograd

Build a tiny automatic-differentiation engine from scratch, the same idea behind PyTorch, then build and train a small neural network on top of it. Two guided projects: first the autograd engine, then the neural net + training loop.

Automatic differentiationComputation graphBackpropagationChain ruleReverse-mode autodiffGradients