synthetic-scenarios
Installation
SKILL.md
Synthetic scenario generation
A coding agent follows the procedure below to generate synthetic evaluation data for an AI agent. The procedure produces a collection of realistic requests, each paired with an expected outcome computed from the database or policy documents, not from a model's own answer.
When to use
Use the procedure when a specification and an authoritative data source already exist, but representative requests and traces do not. The procedure generates requests against an existing application; it does not create the application's database, policies, or expected outcomes.