Cost per token
The posted price of input and output tokens consumed or generated.
Also called
- Token price
- Price per million tokens
Related
- Inference The act of running a trained model to produce an output from inputs, as opposed to training it.
- Batch inference A type of inference where many requests are sent together and answered later, usually at a lower price.
How it connects
- Token priced as Cost per token
- Cost per token adds up to Cost per task
- Usage-based pricing is often charged as Cost per token