Agent Benchmarking

Overview

Vibes don't survive production. This skill picks the right standard benchmark for the agent's domain, builds a custom regression pack from real failures, and wires both into CI so quality is tracked, not assumed.

When to use

• Choosing or upgrading a base model
• Comparing your agent vs vendor agent
• Catching capability regressions across releases
• Defending agent quality to stakeholders with numbers

Standard benchmarks (2026)