skill-release-pipeline
Installation
SKILL.md
Skill Release Pipeline
Ship a reproducible package and an honest result, not a folder plus a marketing claim.
Release contract
- Name one real job and the observable behavior the skill should improve.
- Check the target repository for an incumbent with the same trigger. Evaluate against that incumbent when one exists, not an empty baseline.
- Build the smallest package that can change the target behavior. Keep deterministic operations in
scripts/and conditional detail inreferences/. - Run static gates before spending model calls: strict front matter, package tests, secret scan, license and provenance checks, and exact file hashes.
- Create representative tasks from real work. Separate authoring cases from held-out cases. Make the verifier fail a known-bad output and pass both short and thorough known-good outputs.
- Use the repository's
skill-eval-loopfor blind paired runs. Require at least three valid pairs for an adoption decision. Use more tasks when the public claim depends on a confidence interval. - Confirm that the treatment actually loaded the candidate. A run where it did not load is invocation evidence, not quality evidence.
- Publish the package identity, task definitions, outputs, verifier results, grader verdicts, failures, and limitations. Raw private inputs remain local unless the user explicitly approves disclosure.
- Publish the observed status even when it is negative or inconclusive. Never convert a smoke test, launch review, or attractive example into an efficacy claim.
- Merge only after CI passes, an independent review finds no blocking issue, and the public record identifies the exact shipped package hash.