# Batch inference

A type of inference where many requests are sent together and answered later, usually at a lower price.

Also called: Offline inference, Batch API, Batch processing

Kind of: Inference

Related: Cost per token

Source: https://redfinchadvisory.com/lexicon/batch-inference (version 1.0, changed 2026-10-21)