red-team
Red Team
An adversarial loop-until-dry. The artifact is a target system; the feedback signal is the count of
distinct failure classes you can surface. Each round you craft adversarial inputs aimed at new
weaknesses and run them through the target and a ground-truth oracle via tools/harness.py, which
records every disagreement as a failure and de-dupes by the class (technique) you label each input
with. You loop until fresh rounds stop finding anything new. This is only the find half of a
find→fix setup: it catalogues failures and never patches the target (see Pairing).
When to use
Use to harden a guardrail, classifier, content filter, prompt, or API that the user owns or is explicitly authorized to test — when the goal is a catalogue of distinct, reproducible failures, each an objective target-vs-oracle disagreement. A failure is a bypass (target allows what the oracle would block) or an over-block (target blocks what the oracle would allow).
Default: drive the loop with a runnable oracle so the signal is objective. Escape hatch: if the user has no runnable oracle, the oracle is your judgment against a written policy — apply it consistently and record the intended verdict per input. Not for fixing the target, and not for testing systems outside the user's authorization.