Reasoning effort
A setting which controls how long or how many tokens are spent by a model reasoning before providing an answer.
Also called
- Thinking budget
- Reasoning budget
- Thinking level
- Test-time compute
Kind of
- Inference The act of running a trained model to produce an output from inputs, as opposed to training it.
Related
- Reasoning model A model trained to work through a problem in a sequence of steps and plan its answer before it responds, spending more time and tokens to do better on hard tasks.
- Cost per task The total cost of completing one task with an AI system, counting every model call, retry and tool call, and ideally the human review time.