References
Transformers
- Illustrated Guide to Transformers Neural Network: A step by step explanation
- CS480/680 Lecture 19: Attention and Transformer Networks
- LSTM is dead. Long Live Transformers!
Open AI
Codex
- natural language to code
- Creating a Space Game with OpenAI Codex
- OpenAI Codex
Github Copilot
- Trained on billions of lines of public code
- Your AI pair programmer
- VS Code extension