How language models work
From raw text to a working chatbot. The route most people actually want.
- 1Training Data
- 2Natural Language Processing
- 3Supervised Learning
- 4Curse of Dimensionality
- 5Unsupervised Learning
- 6Tokenization
- 7Perceptron
- 8Regression
- 9Dimensionality Reduction
- 10Token
- 11Neural Network
- 12Loss Function
- 13Activation Function
- 14Embeddings
- 15RNN
- 16Encoder-Decoder
- 17Softmax
- 18Layer Normalization
- 19Self-Supervised Learning
- 20Attention
- 21Self-Attention
- 22Positional Encoding
- 23Transformer
- 24Large Language Model