build-test-suite
Build Test Suite
Guide the user through building a complete test suite — test set + test cases with expected behaviors — for evaluating an AI agent using the coval CLI. Follow the phases below in order, asking questions at each step.
If $ARGUMENTS contains an agent name or use case, use it to skip or pre-fill questions in Phases 1-2.
Phase 0: Setup + Preflight
Step 1: Check authentication
coval whoami
If not authenticated, guide the user:
coval login
This prompts for an API key. Get one at https://app.coval.dev/settings (Organization > Manage > API Keys).
More from coval-ai/coval-external-skills
onboard
>
15launch-run
Launch a Coval evaluation run against an AI agent. Use when user wants to start an evaluation, test an agent, or run simulations.
13coval-resources
Comprehensive overview of ALL Coval platform resources, their hierarchy, relationships, API endpoints, and ID formats. Use when user asks about Coval resources, data model, how things relate, what endpoints exist, or needs context about the platform structure before making API calls.
13quick-eval
Full evaluation workflow - launch a run, watch progress, and summarize results. Use for end-to-end agent testing.
13download-audio
Download audio recordings from Coval voice simulations. Use when user wants to listen to or analyze call recordings.
13watch-run
Monitor a Coval run's progress with live updates. Use when user wants to check run status or wait for completion.
13