ArchitectureTraining
The Llama 3 Herd of Models
Meta·July 31, 2024
Llama Team
View on arXivTL;DR
The technical report for Llama 3, including the 405B model that brought open weights to parity with leading closed frontier models.
Why it matters
A detailed, open account of how a frontier-class model is built — data, scaling, and post-training — and a milestone for open AI.