Series
Unit 1 complete
5 classes
The number system underneath every model, taught from the silicon up.
A from-scratch course on the math machine learning actually runs on, taught through hardware. Every class opens on a line of C that prints something impossible, then builds the math that explains it and proves it on a chip with no floating-point unit. Unit 1 is complete: five classes that build the whole number system, from the real line to floating point, rounding, the overflow cliffs, and integers, fixed-point, and quantization.
Series
Complete
10 parts
How embeddings learn meaning, from first principles.
Ten posts that rebuild the core idea behind every modern language model: the meaning of a word can be captured by its position in a geometric space. Starts from raw text and ends with a working Skip-Gram training loop, with 28 interactive visualisations along the way.
Series
Complete
11 parts
How embeddings learn meaning, from first principles.
Pointers are the part of C and C++ where most learners give up, most bugs live, and most seniors eventually prove their worth. This series takes them apart slowly.