Series
Units 1 & 2 complete
10 classes
The number system underneath every model, taught from the silicon up.
A from-scratch course on the math machine learning actually runs on, taught through hardware. Every class opens on a line of C that prints something impossible, then builds the math that explains it and proves it on a chip with no floating-point unit. Units 1 and 2 are complete: ten classes spanning the whole number system, then functions, sums, counting, and limits. Unit 3 is now underway on the exponential and the logarithm.
Series
Complete
10 parts
How embeddings learn meaning, from first principles.
Ten posts that rebuild the core idea behind every modern language model: the meaning of a word can be captured by its position in a geometric space. Starts from raw text and ends with a working Skip-Gram training loop, with 28 interactive visualisations along the way.
Series
Complete
11 parts
How embeddings learn meaning, from first principles.
Pointers are the part of C and C++ where most learners give up, most bugs live, and most seniors eventually prove their worth. This series takes them apart slowly.