Configure Metrics

Guide the user through selecting, creating, and attaching evaluation metrics for their AI agent using the coval CLI. Follow the phases below in order.

If $ARGUMENTS contains an agent name or use case, use it to skip the relevant question in Phase 1.

Phase 0: Preflight + Inventory

Step 1: Check authentication

coval whoami

If not authenticated, guide the user:

coval login

This prompts for an API key. Get one at https://app.coval.dev/settings (Organization > Manage > API Keys).