Large Language Models: Architecture and Training. From Next-Word Prediction to Reasoning
This talk is a highly visual and accessible look at large language models, their architecture, and their training. Attendees will be presented with the intuitions for tens of LLM concepts like tokenizers, the internals of the latest Transformer neural networks, mixture-of-expert models, reward models, reasoning LLMs, model merging, and more.
Authors
- Jay Alammar
Institutions
- Systems, Applications & Products in Data Processing (Canada) (CA)
Publication Details
- Published
- 2025-08-03
- DOI
- https://doi.org/10.1145/3711896.3736805
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00