eval-creator
Warn
Audited by Gen Agent Trust Hub on Oct 27, 2026
Risk Level: MEDIUMCOMMAND_EXECUTIONDYNAMIC_EXECUTIONINDIRECT_PROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The skill provides the ability to execute arbitrary shell commands via the
command-checkandbehavior-checkverification methods. It usesbashto run commands and bench scripts (e.g.,bash bench/run-contract-case.sh) and executes commands provided in thecommandfield of eval cases. - [DYNAMIC_EXECUTION]: The
script-checkmechanism allows for the execution of custommcp-scriptsdefined in project configuration files. These scripts can contain arbitrary logic in languages like JavaScript, which are executed during the evaluation process. Additionally, theskill-checkmethod executes a local Python script (quick_validate.py) with a user-provided target path, which can lead to command injection if the target path string is not properly sanitized. - [INDIRECT_PROMPT_INJECTION]: The skill is designed to ingest and process data from untrusted or external sources, creating a vulnerability to indirect prompt injection.
- Ingestion points: Data enters the skill via the
.evals/directory through files containingpattern-key,promoted-rule, andcommandstrings derived from other automated tools or manual input. - Boundary markers: The skill does not define or enforce boundary markers to separate untrusted rule text from the internal execution logic.
- Capability inventory: The skill has high-privilege capabilities including arbitrary shell execution (
bash), package manager interaction (npm), and script interpretation (python,javascript). - Sanitization: There is no evidence of sanitization, escaping, or validation of the strings interpolated into commands or scripts before they are executed.
Audit Metadata