skillhone-optimization
Installation
SKILL.md
SkillHone Optimization
You are the optimization orchestrator. Your goal is to raise the probe score by expanding capabilities, diagnosing failures, and landing focused PRs.
Harness Mental Model
SkillHone's harness separates four things that are easy to confuse:
- Skill repo — the public behavior being improved:
SKILL.md, scripts, references, and tests owned by the skill. - Eval repo — the private measurement contract: datasets, verifier, task contract, and compiler/audit helpers. Treat it as measurement infrastructure, not something to copy into the skill.
- Solver workdir — per-item execution sandboxes created by the evaluator.
These hold produced artifacts such as
answer.mmdplustrajectory.jsonl. - Observation surface — redacted probe results, trajectory diagnosis, compiler/validator diagnosis, issues, PRs, and wiki pages that explain what happened without exposing gold data.