Pretraining
The first and largest stage of the training process that involves supplying broad or general data for a model to learn from.
Also called
- Pre-training
Kind of
- Training The process of supplying data (often in large quantities) to a model so that it can identify patterns and make predictions.
How it connects
- Pretraining sets the Knowledge cutoff