Fundamentals of Large Language Models
Large Language Models (LLMs) are AI systems trained on massive corpora to understand and generate human language. This lens distills the foundations behind their architecture, training processes, alignment, and evaluation. It serves as a concise, practical guide for anyone building with modern LLMs.
Tap to Preview

Foundations

  • Word Vector Representations: word2vec

  • Efficient Estimation of Word Representations in Vector Space

  • But what is a neural network? | Deep learning chapter 1

  • Chapter 2 Gradient descent, how neural networks learn

  • Chapter 3: Analyzing our neural network

  • What is backpropagation really doing?

  • Backpropagation calculus | Deep Learning Chapter 4

    • Transformer: Architecture

  • Transformer: A Novel Neural Network Architecture for Language Understanding

  • Attention Is All You Need