AgentV Skill

Use this skill to author, run, and manage evaluations for AI agents and skills using the AgentV CLI and the AgentEvals declarative YAML standard.

Read references/eval-yaml-schema.md for the complete EVAL.yaml schema reference before authoring new eval files. Read references/targets.md for target configuration options.

When to use this skill

• The user wants to write EVAL.yaml evaluation files for a skill or agent.
• The user wants to run evals with agentv eval.
• The user wants to convert existing test cases (e.g., evals.json) to EVAL.yaml format.
• The user wants to understand the AgentEvals specification or schema.
• The user wants to set up or update .agentv/targets.yaml.
• The user wants to run agentv compare to detect regressions across runs.
• The user wants to integrate AgentV into a CI/CD pipeline.
• The user wants to write LLM judges, rubrics, or code graders for evaluation.
• The user wants to run the same eval against two different targets or models to compare performance.