Training

PaLM: Scaling Language Modeling with Pathways

Google·April 5, 2022

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin

TL;DR

A 540B-parameter model trained on the Pathways system, strong on reasoning and multilingual tasks.

Google’s flagship scaling result and a foundation for the line that became Gemini.