Deep Dive into LLMs like ChatGPT

[1hr Talk] Intro to Large Language Models

The spelled-out intro to neural networks and backpropagation: building micrograd

Let's build GPT: from scratch, in code, spelled out.

How I use LLMs

Let's reproduce GPT-2 (124M)

Let's build the GPT Tokenizer