skill-creator
Pass
Audited by Gen Agent Trust Hub on Sep 19, 2026
Risk Level: SAFEDYNAMIC_EXECUTIONINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONPRIVILEGE_ESCALATION
Full Analysis
- [DYNAMIC_EXECUTION]: The skill creator instructions specifically direct the agent to "write and run a script" for grading assertions during the evaluation process. Additionally, the
scripts/init_skill.pyfile dynamically generates Python scripts from hardcoded templates and saves them to the filesystem. - [INDIRECT_PROMPT_INJECTION]: The skill processes potentially untrusted data that could contain malicious instructions.
- Ingestion points: Reads and processes user feedback from
feedback.json, test prompts fromevals.json, and the generated outputs from other skills being tested. - Boundary markers: The instructions do not define explicit boundary markers or "ignore" instructions when the agent processes feedback or test results.
- Capability inventory: The skill can spawn subagents, execute multiple local Python scripts (
scripts.aggregate_benchmark,eval-viewer/generate_review.py,scripts.run_loop), write files, and package skill archives. - Sanitization: There is no evidence of sanitization or strict schema validation for the contents of the feedback or test outputs before they are used to influence subsequent skill generation or improvement steps.
- [COMMAND_EXECUTION]: The
SKILL.mdinstructions guide the agent to execute various local Python modules and system commands using shell syntax, includingnohup,kill, andpython -m scripts.*. - [PRIVILEGE_ESCALATION]: The
scripts/init_skill.pyscript useschmod(0o755)to grant execution permissions to theexample.pyscript it generates. While typical for setup tasks, it represents a pattern of privilege modification on the local filesystem.
Audit Metadata