capture-eval-issues
/capture-eval-issues
Capture noteworthy review violations into the eval inventory.
Input
This skill receives one or more review JSON file paths as arguments (space-separated).
Example: /capture-eval-issues validator_logs/review_src_claude@1.0.json validator_logs/review_src_gemini@2.0.json
Procedure
- Read
judge-prompt.mdfrom this skill's directory - Spawn a subagent to judge and capture violations:
- Task tool:
Taskwithsubagent_type="general-purpose",model="sonnet",prompt=judge-prompt content +"\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>" - The subagent handles everything: reading files, judging, calling the append script
- Task tool:
- Report the subagent's capture summary (the
CAPTURED:line)
More from codagent-ai/agent-validator
validator-help
Diagnoses and explains validator behavior from runtime evidence for requests such as "why did validator fail", "explain validator behavior", "diagnose validator logs", or "what went wrong in the validator run".
16validator-commit
>-
16validator-check
>-
16validator-skip
Advances the validator execution state baseline without running checks for requests such as "skip validator", "advance validator baseline", or "mark current tree as validated without running checks".
16validator-setup
Scans the project and configures checks and reviews for Agent Validator for requests such as "set up validator", "configure checks and reviews", or "initialize validator for this repo".
16validator-issue
Files structured GitHub bug reports for agent-validator when users ask to file, report, or open an issue for a suspected defect
16