autoresearch-agent
Fail
Audited by Gen Agent Trust Hub on Apr 12, 2026
Risk Level: HIGHCOMMAND_EXECUTIONREMOTE_CODE_EXECUTIONDATA_EXFILTRATIONPROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The primary execution scripts,
run_experiment.pyandsetup_experiment.py, usesubprocess.run(shell=True)to execute theevaluate_cmd. This command is often constructed from user input or agent-modified configuration, creating a direct path for shell injection. - [COMMAND_EXECUTION]: Multiple evaluator scripts, including
benchmark_speed.py,benchmark_size.py,build_speed.py,memory_usage.py, andtest_pass_rate.py, utilizesubprocess.runwithshell=Trueto perform build and measurement tasks. This implementation pattern significantly increases the skill's attack surface. - [REMOTE_CODE_EXECUTION]: The core logic of the skill involves the agent making autonomous edits to a target file and then executing a command that likely runs that modified code. This unsupervised write-then-execute loop allows for arbitrary code execution in the local environment.
- [DATA_EXFILTRATION]: The 'LLM Judge' evaluators (
llm_judge_content.py,llm_judge_copy.py,llm_judge_prompt.py) read the content of the target file and send it as a prompt to external CLI tools likeclaude,codex, orgemini. This results in the transmission of local file content to external service providers. - [PROMPT_INJECTION]: The autonomous loop is governed by instructions read from
results.tsvandprogram.md. An attacker or a malicious evaluation output could inject instructions into these files (Indirect Prompt Injection), potentially causing the agent to deviate from its optimization goal or perform harmful actions during subsequent iterations. - [COMMAND_EXECUTION]: The
/ar:loopcommand implements persistent execution by usingCronCreateto schedule the agent's optimization tasks. This persistent autonomy, combined with the ability to modify and execute code, represents a high-risk capability.
Recommendations
- AI detected serious security threats
Audit Metadata