run-adversarial-testing
Run Adversarial Testing
Set up and launch a Coval adversarial / red-team sweep end-to-end: one agent, one
adversarial test set (each test case is a different bad-actor approach), one
persistent Adversarial User persona, one Composite Evaluation metric that
scores each scenario against its own expected_behaviors, a multi-iteration run,
a per-scenario pass/fail scorecard, and a saved report grouped by Test
Case. Mirrors the public cookbook at
https://docs.coval.dev/guides/adversarial-red-team-testing.
Unlike the accent and audio-quality cookbooks (which vary the persona and compare by Persona), adversarial testing is test-case-centric: the attack variety lives in the test set, one neutral persistent persona drives every scenario, and the comparison axis is the test case (the attack vector). The headline question for every scenario is the same: did the agent navigate this adversarial scenario correctly?