Apastra Validate

Validate PromptOps files against the apastra JSON schemas. Catches formatting errors, missing required fields, and invalid values before you run evaluations.

When to Use

Use this skill when you want to:

• Check that prompt specs, datasets, evaluators, suites, and quick eval files are correctly formatted
• Validate inline assertions on dataset cases
• Validate files after scaffolding or manual edits
• Debug why an evaluation run is failing

Validation Process

When asked to validate (e.g., "validate my promptops files"):

Step 1: Discover Files

Scan the promptops/ directory for files to validate: