afshinea/stanford-cme-295-transformers-large-language-models

VIP cheatsheet for Stanford's CME 295 Transformers and Large Language Models

What it solves

This project provides a centralized, concise reference for the complex concepts taught in Stanford's CME 295 course on Transformers and Large Language Models (LLMs), helping students and practitioners consolidate their understanding of the field.

How it works

The repository offers a comprehensive "VIP Cheatsheet" that summarizes core technical topics into a single, accessible format. It serves as a companion to the "Super Study Guide" book, which provides in-depth explanations and visual aids for the same curriculum.

Who it’s for

It is designed for students enrolled in the Stanford CME 295 course and any learners or professionals seeking a structured overview of modern AI architecture and training techniques.

Highlights

  • Covers foundational Transformer architecture, including self-attention and variants.
  • Details LLM training methods like fine-tuning (SFT, LoRA) and preference tuning (RLHF, DPO).
  • Explains technical optimizations such as distributed training, KV caching, and speculative decoding.
  • Includes information on advanced applications like AI agents and evaluation.
  • Available in 15 different languages to support a global audience.

Related

  • Project
  • Project
  • Project
  • Project