run-adversarial-testing

Installation
SKILL.md

Run Adversarial Testing

Set up and launch a Coval adversarial / red-team sweep end-to-end: one agent, one adversarial test set (each test case is a different bad-actor approach), one persistent Adversarial User persona, one Composite Evaluation metric that scores each scenario against its own expected_behaviors, a multi-iteration run, a per-scenario pass/fail scorecard, and a saved report grouped by Test Case. Mirrors the public cookbook at https://docs.coval.dev/guides/adversarial-red-team-testing.

Unlike the accent and audio-quality cookbooks (which vary the persona and compare by Persona), adversarial testing is test-case-centric: the attack variety lives in the test set, one neutral persistent persona drives every scenario, and the comparison axis is the test case (the attack vector). The headline question for every scenario is the same: did the agent navigate this adversarial scenario correctly?

Installs
3
GitHub Stars
3
First Seen
Sep 23, 2026