Vally Tests Skill

Purpose

This skill authors Vally conformance tests for the four supported artifact kinds in this repository: prompts, instructions, agents, and skills. Each test exercises a documented behavior the artifact already claims and routes the result through an appropriate Vally grader so failures are explainable. Test authoring is bounded by a refusal taxonomy that keeps the skill out of adversarial, harmful, or policy-evasion territory.

Follow the shared content-policy public-output guard for eval stimuli and any public summaries derived from this skill. Vally tests are not a venue for terms-of-service boundary mapping, payload generation, refusal-text scoring, hidden-instruction disclosure, PII extraction, or secret extraction.

The skill ships:

• A canonical authoring workflow that runs directly through /vally-tests or through the Vally Test Author subagent.
• Per-kind reference files that enumerate every conformance check the skill knows how to express.
• A grader catalog that maps Vally CLI grader types to the checks they fit, and robustness rules that keep an emitted grader from asserting the impossible or failing correct behavior.
• A safety refusal taxonomy with regex patterns the safety lint script consumes.
• Helper scripts and asset templates for stimulus emission, corpus import, and dedupe.

When to Invoke