Agent Eval Skill

A lightweight CLI tool for comparing coding agents head-to-head on reproducible tasks. Every "which coding agent is best?" comparison runs on vibes — this tool systematizes it.

When to Activate

• Comparing coding agents (Claude Code, Aider, Codex, Cursor, Augment, etc.) on your own codebase
• Measuring agent performance before adopting a new tool or model
• Running regression checks when an agent updates its model or tooling
• Producing data-backed agent selection decisions for a team

2026 Evaluation Landscape

The harness (tools, prompts, context) matters as much as the model. When evaluating, isolate whether differences come from the model or the harness.