prompt-lab
Installation
SKILL.md
STOP. READ THIS ENTIRE SKILL.MD BEFORE CALLING ANY ENDPOINT.
Prompt Lab
Systematic prompt engineering with ground truth evaluation and self-correction loop.
Key Feature: Self-Correction Loop
Unlike simple validation that silently filters invalid outputs, this skill:
- Presents vocabulary in prompt - LLM knows valid options upfront
- Validates response - Pydantic catches invalid tags
- Sends correction back to LLM - "You used invalid tags X. Valid options are Y. Please fix."
- Tracks correction rounds - Metrics show how often LLM needed help
This gives the model a chance to self-correct rather than silently failing.