Transformers from Scratch

A few years ago, I had the chance to teach a course on "deep learning in practice" during COVID for Duke undergrads. It was an amazing experience. I met smart, motivated peers, and I learned firsthand the idiom "the best way to learn is to teach".

One of the missing lectures from that course was a deep dive on transformers. So, 5 years later, here we are.

Stay tuned.