home About Projects Culti7 Blog Courses Papers

Blog

Long-form series, read like chapters. I like to understand things from first principles, and that's how these are built.

Complete · 10 chapters

Before Transformers

How did machines learn to read? Not with transformers. Long before attention, there was a small, honest chain of ideas: telegraph codes, a matrix of counts, a dot product, softmax, and one absurdly clean gradient. These ten chapters build the whole chain from scratch, with interactive toys to poke at in every one. If you've ever nodded along to the word "embeddings" without quite believing yourself, start at chapter one.

Start at chapter one

3 of 11 chapters live

Pointers: Thinking in Memory

C's most feared feature is really one mental picture: memory as numbered boxes, and a pointer as a box that holds another box's number. Eleven chapters take you from why pointers exist at all, through the three classic bugs, const contracts, aliasing, and void*, up to smart pointers and a finale on undefined behaviour. Written for anyone who has compiled C before and still flinches at the asterisk.

Start at chapter one

Coming

Standalone posts

Shorter one-off pieces will live here between the series.