generating-mod-envs

Installation
SKILL.md

Generating mod learning envs

Use this skill to create JSON envs consumed by /mods learn --env=<path> or bun scripts/mod-learning/learn-mod.ts --env <path>. An env describes the mod behavior to learn and the scenario-suite eval used to score candidates.

Workflow

  1. Define the behavior and eval before writing JSON.
    • What should the mod do? Tool, turn event, tool event, provider, command, status, etc.
    • What would a placebo/no-op mod fail?
    • What unique sentinel strings make success unambiguous?
  2. Choose a path:
    • Repo example: docs/examples/mods/learning/<slug>.env.json
    • Local/private: any user-requested path
  3. Draft strict JSON. Start from assets/mod-learning-env.template.json if useful. No comments or trailing commas.
  4. Prefer evaluation.scenarios with at least:
    • happy path
    • discrimination/exact-target path
    • negative control
  5. Validate:
Installs
1
GitHub Stars
2.8K
First Seen
2 days ago
generating-mod-envs — letta-ai/letta-code