autoresearch-agent
Fail
Audited by Gen Agent Trust Hub on Sep 4, 2026
Risk Level: HIGHPERSISTENCECOMMAND_EXECUTIONDYNAMIC_EXECUTIONINDIRECT_PROMPT_INJECTION
Full Analysis
- [PERSISTENCE]: The skill implements an autonomous background loop via the
/ar:loopcommand. According toskills/status/SKILL.mdandSKILL.md, this functionality creates recurring jobs and references 'cron ID', indicating that the skill modifies system schedules (crontab) to maintain execution across sessions.\n- [COMMAND_EXECUTION]: Multiple scripts, includingscripts/run_experiment.py,scripts/setup_experiment.py, and several files in theevaluators/directory, utilizesubprocess.runwithshell=True. This is used to execute benchmark commands and evaluation logic defined inconfig.cfg, creating a high-risk surface for shell command injection or arbitrary execution if the configuration is tampered with.\n- [DYNAMIC_EXECUTION]: The experiment runner logic (scripts/run_experiment.py) dynamically invokes theevaluate_cmdspecified in the experiment's configuration file. This allows for the execution of arbitrary scripts or binaries during every iteration of the autonomous optimization loop.\n- [INDIRECT_PROMPT_INJECTION]: The skill includes LLM-based evaluation scripts (evaluators/llm_judge_content.py,evaluators/llm_judge_copy.py,evaluators/llm_judge_prompt.py) that ingest untrusted content from target files for quality assessment.\n - Ingestion points: The scripts read the content of files specified as optimization targets (e.g.,
content/titles.md,posts.md,SKILL.md).\n - Boundary markers: Prompts use basic markdown delimiters (
---) to separate instructions from target content but lack robust safety instructions to ignore embedded malicious commands.\n - Capability inventory: The skill has broad capabilities, including executing shell commands via
subprocess, writing results to local files, and performing git operations (commit/reset).\n - Sanitization: No sanitization or filtering of the target file content is performed before interpolation into the evaluation prompt.
Recommendations
- AI detected serious security threats
Audit Metadata