generating-mod-envs
Installation
SKILL.md
Generating mod learning envs
Use this skill to create JSON envs consumed by /mods learn --env=<path> or bun scripts/mod-learning/learn-mod.ts --env <path>. An env describes the mod behavior to learn and the scenario-suite eval used to score candidates.
Workflow
- Define the behavior and eval before writing JSON.
- What should the mod do? Tool, turn event, tool event, provider, command, status, etc.
- What would a placebo/no-op mod fail?
- What unique sentinel strings make success unambiguous?
- Choose a path:
- Repo example:
docs/examples/mods/learning/<slug>.env.json - Local/private: any user-requested path
- Repo example:
- Draft strict JSON. Start from
assets/mod-learning-env.template.jsonif useful. No comments or trailing commas. - Prefer
evaluation.scenarioswith at least:- happy path
- discrimination/exact-target path
- negative control
- Validate: