Posts
Regularization
May 3, 2026 Data Augmentation, Weight Decay, Dropout, Label Smoothing, and Early Stopping.
Optimizers
April 24, 2026 Stochastic Gradient Descent, Momentum, RMSProp, and Adam. How to use gradients.
Backpropagation
April 11, 2026 The first post in the “Notebook of Things I Don’t Know About”. A simple rederivation and NumPy implementation of the Backpropagation algorithm for feedforward networks.
The Many Faces of Mean Field Theory
February 4, 2026 Variational principles, field theory, and the physics of the Ising Model.
