ai-system-testing

Installation
SKILL.md

Quick Route

Situation Go to
Prompt changed, need to catch quality regressions Prompt Regression Testing → references/prompt-regression.md
Run the same prompt across providers/models and compare Cross-Provider Regression → references/tooling-evals.md
Score open-ended output (relevance/completeness/safety) Response Quality Evaluation → references/eval-framework.md
Agent calls tools/functions — verify selection and args Tool-Call Validation → references/tooling-evals.md
Output is nondeterministic and exact-match keeps flaking Nondeterminism Strategies
AI states facts / cites sources / runs over RAG Hallucination & Grounding
Pre-launch jailbreak, injection, PII, system-prompt leak AI Safety Testing → references/tooling-evals.md
An AGENT (test harness, coding agent) reads tool output / RAG / scan reports / logs Agent-as-Target Injection → references/injection-detector.md
Installs
478
GitHub Stars
96
First Seen
Apr 1, 2026
ai-system-testing — petrkindlmann/qa-skills