Foundation Models
Large models pretrained broadly, then adapted to many tasks.
A foundation model is trained on broad data at scale and serves as a general base that can be adapted — by fine-tuning or prompting — to a wide range of downstream tasks. The term, coined in 2021, captures the platform-like role of models like GPT and CLIP.