ADK Evaluation Guide

Iron Law

NEVER evaluate agents against the live Gemini API in unit tests. Use adk eval with evalsets. Hitting the real API in eval makes results non-deterministic, incurs cost, and breaks CI. Always run evaluations through the ADK eval CLI with a defined evalset and config file.

Reference Files

File	Contents
`reference/criteria-guide.md`	Complete metrics reference — all 8 criteria, match types, custom metrics, judge model config
`reference/user-simulation.md`	Dynamic conversation testing — ConversationScenario, user simulator config, compatible criteria
`reference/builtin-tools-eval.md`	google_search and model-internal tools — trajectory behavior, metric compatibility
`reference/multimodal-eval.md`	Multimodal inputs — evalset schema, built-in metric limitations, custom evaluator pattern

adk-eval-guide

ADK Evaluation Guide

Iron Law

Reference Files

Process