Foundation model
A model trained on broad data, mostly with self-supervised learning, that can be adapted, for example through fine-tuning or post-training, for a variety of downstream tasks.
Also called
- GPAI model
- General-purpose AI model
Kind of
- Model The trained set of numbers (parameters) and structure that takes an input and produces an output; the part of an AI system that does the predicting.
How it connects
- Machine learning includes, via deep learning Foundation model
- Training makes Foundation model
- Generative AI usually runs on Foundation model
- Foundation model is most often an LLM
- Frontier model is the current best of Foundation model
- Open weights is one way to release a Foundation model