bench
Fail
Audited by Gen Agent Trust Hub on Oct 10, 2026
Risk Level: HIGHREMOTE_CODE_EXECUTIONCOMMAND_EXECUTIONPRIVILEGE_ESCALATIONINDIRECT_PROMPT_INJECTIONEXTERNAL_DOWNLOADS
Full Analysis
- [REMOTE_CODE_EXECUTION]: The skill provides instructions in
references/onboarding.mdto install the 'Hunk' tool using acurl -fsSL https://hunk.dev/install.sh | shpipe. This represents a high-risk remote execution pattern from an unverified source, which an agent might execute directly if tasked with environment setup. - [COMMAND_EXECUTION]: The
resolve_bench_config.pyscript allows an untrusted repository to define arbitrary commands in a.bench/config.tomlfile. The skill instructions inSKILL.mdthen direct the agent to execute these commands via a UI adapter, enabling arbitrary code execution on the host machine by a malicious repository. - [PRIVILEGE_ESCALATION]:
SKILL.mdexplicitly instructs the agent to runmise truston anymise.tomlfile found in a new bench workspace. This action authorizes the execution of arbitrary shell hooks and scripts defined by the repository, bypassing the safety prompts typically required for environment configuration tools. - [INDIRECT_PROMPT_INJECTION]: The skill exhibits an attack surface for indirect prompt injection.
- Ingestion points: PR metadata, ticket metadata, and repository-provided configuration files (
.bench/config.toml,mise.toml). - Boundary markers: The skill uses basic prompt prefixes like 'Read {brief}, then plan before edits' but lacks rigorous sanitization or escaping of the ingested content.
- Capability inventory: The agent has the ability to execute VCS commands, manage terminal sessions via
zmxandsupacode, and run arbitrary commands defined in the workspace configuration viasubprocess.run. - Sanitization: While the Python scripts use
shlexto safely handle command-line arguments, there is no evidence of sanitization for the natural language content provided to the harness agents, allowing malicious instructions in PRs or tickets to potentially influence agent behavior. - [EXTERNAL_DOWNLOADS]: The skill references and recommends downloading software from unverified third-party sources like
hunk.devand GitHub repositories such asrockorager/comview, which are not part of the recognized trusted vendor infrastructure.
Recommendations
- AI detected serious security threats
Audit Metadata