Karpathy Makes GPT from Scratch
X-Tesla AI-Lead shows how to makeGeneratively Pretrained Transformer (GPT). He followed the paper “Attention is All You Need” and OpenAI’s GPT-2 / GPT-3. He talk about connections to ChatGPT, which has taken the world by storm. We also watch GitHub Copilot, itself a GPT, help us write a GPT. Watch the makemore videos to get …