vally-tests
Vally Tests Skill
Purpose
This skill authors Vally conformance tests for the four supported artifact kinds in this repository: prompts, instructions, agents, and skills. Each test exercises a documented behavior the artifact already claims and routes the result through an appropriate Vally grader so failures are explainable. Test authoring is bounded by a refusal taxonomy that keeps the skill out of adversarial, harmful, or policy-evasion territory.
Follow the shared content-policy public-output guard for eval stimuli and any public summaries derived from this skill. Vally tests are not a venue for terms-of-service boundary mapping, payload generation, refusal-text scoring, hidden-instruction disclosure, PII extraction, or secret extraction.
The skill ships:
- A canonical authoring workflow used by the Vally prompts and
Vally Test Authorsubagent. - Per-kind reference files that enumerate every conformance check the skill knows how to express.
- A grader catalog that maps Vally CLI 0.9.0 grader types to the checks they fit.
- A safety refusal taxonomy with regex patterns the safety lint script consumes.
- Helper scripts and asset templates for stimulus emission, corpus import, and dedupe.
When to Invoke
Invoke this skill in one of two modes: