Jailbreak
A type of AI system attack which attempts to 'convince' a system to ignore its rules, guardrails, or system instructions.
There are levels of guardrails that can defend against an attack of this sort, but the viability of these attacks is why deterministic guardrails should also be in place.
Kind of
- AI security The practice of defending an AI system, and the data and tools it can reach, from attackers and deliberate misuse.
Often confused with
- Prompt injection A type of AI system attack where text the system reads contains instructions, and the system follows them as if they came from its user or owner.
Related
- Deterministic guardrail A guardrail that uses fixed rules or code so that it applies the same way every time.