reproduce-then-fix
Pass
Audited by Gen Agent Trust Hub on Aug 21, 2026
Risk Level: SAFECOMMAND_EXECUTIONPROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The script
scripts/verified_red.pyinvokessubprocess.Popenwithshell=Trueto run user-provided test commands. This is designed to support complex command lines involving pipes and redirections, but it grants the ability to execute arbitrary shell commands. The script contains explicit warnings in its docstring advising against running untrusted commands.\n- [INDIRECT_PROMPT_INJECTION]: The tool parses the output of executed test commands to differentiate between environment setup errors and valid test failures. This process involves reading potentially untrusted data from the command's output stream.\n - Ingestion points: The
mergedoutput fromproc.communicate()in therun_testfunction inscripts/verified_red.py.\n - Boundary markers: None identified in
scripts/verified_red.py; the script reads the entire combined stdout/stderr stream.\n - Capability inventory: The script performs file system operations (copying, directory creation), manages git worktrees, and executes shell commands in
scripts/verified_red.py.\n - Sanitization: Employs regex matching (
INFRASTRUCTURE_RED,TESTS_RAN) to categorize the output inscripts/verified_red.py, rather than executing the output itself.\n- [SAFE]: Thescripts/verified_red.pyscript includes sophisticated path validation to prevent directory traversal attacks. It usesresolve()andis_relative_to()to ensure that all file operations are confined within the repository and the temporary worktree, specifically checking for and refusing to write through symlinks that point outside the worktree.
Audit Metadata