Agent Evaluation

Build evidence that can inform a release owner, not a showcase of favorable examples or a safety certification.

Use when

• Define quality before building or changing an agent.
• Compare prompts, models, tools, memory strategies, or orchestration patterns.
• Convert production failures into regression cases.
• Establish a repeatable release gate or human-review plan.

Inputs

Collect the agent objective, users, supported tasks, unacceptable outcomes, current baseline, execution environment, available traces, and evaluation budget. State assumptions when an input is unavailable.

Output contract

Produce: