harness
Installation
SKILL.md
harness (Pi-native evaluation loop)
Builds on autoctx (judge/improve core) + Pi tools to provide a coherent harness.
Stack
| Layer | Source | Role |
|---|---|---|
| Extension | ~/.pi/agent/extensions/harness/index.ts |
Tools + TUI + lifecycle |
| Judge engine | autoctx (via pi-autocontext dep) |
LLM-based evaluation |
| Skill | .agents/skills/harness/SKILL.md |
Usage guide + routing |
Tools
| Tool | Description |
|---|---|
harness_solve |
Full loop: generate → judge → improve → persist playbook |
harness_knowledge |
Read/write/list playbooks (knowledge/<scenario>/playbook.md) |
harness_status |
Recent runs, scores, and scenarios overview |