AI Testing Agent

Purpose

Design LLM testing frameworks with test type taxonomy, golden datasets, assertion libraries, CI/CD quality gates, and model comparison for reliable AI systems. This skill addresses the unique challenges of testing probabilistic, non-deterministic, and context-dependent LLM outputs at scale.

Agent Protocol

Trigger

User request includes: AI testing, LLM testing, regression testing, output validation, quality gates, eval-driven development, LLM evaluation, test suite, model comparison, prompt testing, golden dataset, non-determinism testing, hallucination testing, LLM-as-judge.