Small language model
A language model that is small relative to frontier models, usually a few billion parameters, and can be run cheaply, often on local hardware.
Also called
- SLM
Kind of
- Model The trained set of numbers (parameters) and structure that takes an input and produces an output; the part of an AI system that does the predicting.
The other half
- LLM A very large model trained on huge amounts of text to predict the next word, which lets it write, summarize, answer questions and follow instructions.
Related
- Open weights A model whose weights (numbers that the model learned in training) are published for anyone to download and run, usually without the training data or code, and under the vendor's license terms.