ai-system-testing
Installation
SKILL.md
Quick Route
| Situation | Go to |
|---|---|
| Prompt changed, need to catch quality regressions | Prompt Regression Testing → references/prompt-regression.md |
| Run the same prompt across providers/models and compare | Cross-Provider Regression → references/tooling-evals.md |
| Score open-ended output (relevance/completeness/safety) | Response Quality Evaluation → references/eval-framework.md |
| Agent calls tools/functions — verify selection and args | Tool-Call Validation → references/tooling-evals.md |
| Output is nondeterministic and exact-match keeps flaking | Nondeterminism Strategies |
| AI states facts / cites sources / runs over RAG | Hallucination & Grounding |
| Pre-launch jailbreak, injection, PII, system-prompt leak | AI Safety Testing → references/tooling-evals.md |
| An AGENT (test harness, coding agent) reads tool output / RAG / scan reports / logs | Agent-as-Target Injection → references/injection-detector.md |