agent-testing-patterns
Installation
SKILL.md
Agent Testing Patterns
Test AI agent systems that use tools, make decisions, and produce non-deterministic outputs.
Testing Challenges
| Challenge | Cause | Strategy |
|---|---|---|
| Non-deterministic output | LLM randomness | Assert on structure, not exact text |
| Tool use sequences | Agent autonomy | Verify tool calls, not call order |
| Multi-turn state | Conversation context | Snapshot-based assertions |
| Cost | API calls | Mock LLM in unit tests |
| Latency | API round-trips | Parallel test execution |
| Flakiness | Model updates | Semantic assertions, not string matches |