This contains code for training makemore, gpt-1 and gpt-2. I have mostly followed Karpathy's videos, except for a few tweaks or explorations.
The code is meant for experimentation and quick-iteration, so you'll find a lot of commented/uncommented sections.