Build a useful Coval test suite

Create tests that change a product decision. A small set covering distinct failure mechanisms is more useful than many paraphrases of a happy path.

Understand and reuse

Confirm organization/workspace, agent and scope. Inspect the selected agent, existing cases, relevant recordings and the customer's source-of-truth policy. Use coval --agent agents get <id>, test-sets get, and test-cases list --test-set-id <id>. Check command help, errors and pagination. Do not replace an existing suite or derive requirements solely from a buggy agent prompt.

For a large corpus, distill-test-set can help shortlist source rows; inspect its resulting input/expectation pairs. For unexplored conversations, use coval-discover-failures. Neither is mandatory when the requirement is known.

Design the coverage before prose