Jailbreak
also: red-teaming
A prompt crafted to make a model ignore its safety rules — and the practice of hunting for them.
A jailbreak manipulates a model into violating its own policies — role-play framings, encoding tricks, many-shot patterns, or slow multi-turn escalation. Red-teaming is the defensive discipline: systematically attacking your own system to find these holes before users do. Distinct from prompt injection, which hijacks an application through untrusted content; jailbreaks target the model’s rules directly.