Human oversight

Human involvement in an AI process to monitor, govern or stop it, before it acts, after it acts, or only for certain actions.

Also called

Human-in-the-loop A setup where a person approves each action before it happens.
Human-on-the-loop A setup where an agent acts on its own while a person watches and can step in or stop it.
Human-out-of-the-loop A setup where an AI system or agent runs with no person watching, reviewing or approving its work.

Guardrail A check, built into the harness or written into the instructions, that screens what goes in, what comes out, or what an agent tries to do.
Levels of autonomy A scale of how much you hand over to an AI system or agent: nothing to act on, an instruction, an outcome, or an area to look after.
Kill switch A control that stops an agent or model at once.
High-risk AI An AI system used where errors can seriously affect people's health, safety or rights, such as hiring, credit, education or critical infrastructure, which brings strict legal duties.