add-benchmark
Pass
Audited by Gen Agent Trust Hub on Nov 5, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADS
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill describes a workflow where untrusted model output is ingested and processed by verification logic.
- Ingestion points: The
verify()method inapp.pyreceivesBaseVerifyRequestwhich includesbody.response.output_text(model-generated content). - Boundary markers: The instructions suggest stripping
<think>/<thinking>blocks but do not enforce strict boundary delimiters for inputs passed to execution environments. - Capability inventory: The skill explicitly uses
subprocess.runandray.remoteto execute code extracted from model responses. - Sanitization: Recommends markdown code block extraction and specific block stripping, though these are for parsing logic rather than security sanitization.
- [DYNAMIC_EXECUTION]: The skill provides patterns for runtime code execution to facilitate benchmarking.
- Evidence: The "Subprocess execution server" and "Subprocess Execution with Ray" patterns in
references/patterns.mddemonstrate executing extracted model code usingsubprocess.runand Ray tasks. - Mitigation: The skill correctly recommends using
tempfile.TemporaryDirectoryfor filesystem isolation andasyncio.Semaphorefor resource limiting. - [COMMAND_EXECUTION]: The skill facilitates shell command execution for environment setup.
- Evidence: The "External Tool Auto-Install Pattern" uses
subprocess.runto execute bash scripts (install_tool.sh) and system package managers (brew) during server startup. - [EXTERNAL_DOWNLOADS]: The skill describes mechanisms for fetching external resources at runtime.
- Evidence: Instructions for auto-installing compilers and runtimes from external sources via setup scripts. It also covers downloading datasets from a GitLab registry using MLflow.
Audit Metadata