distill-test-set

Installation
SKILL.md

Distill Test Set

Turn a large, noisy dataset into a small, high-signal Coval test set. Big datasets are the wrong input for simulation: running thousands of sims is slow, expensive, and likely to overwhelm the agent under test, and most rows are duplicates, paraphrases, or boilerplate. The goal is a representative 10–50 case suite that covers the agent's real scenarios once each, weighted toward known failures.

Drive everything through the coval CLI and the bundled scripts/distill.py. Follow the phases in order. Present a summary and get confirmation before creating anything.

If $ARGUMENTS is a Coval test set id (8 chars) or a file path, use it as the source in Phase 1.

Installs
23
GitHub Stars
2
First Seen
Jun 19, 2026
distill-test-set — coval-ai/coval-external-skills