manage-evals
Pass
Audited by Gen Agent Trust Hub on Oct 16, 2026
Risk Level: SAFECOMMAND_EXECUTIONEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The skill includes a specialized Python script and shell instructions to dispatch GitHub Action workflows and perform local comparison of evaluation metrics.\n- [EXTERNAL_DOWNLOADS]: Fetches structured evaluation results and metadata from the project's dedicated CDN at
results.eval.all-hands.dev. These downloads are neutral and associated with the vendor's own infrastructure.\n- [INDIRECT_PROMPT_INJECTION]: The skill ingests data from external evaluation reports and interpolates it into GitHub comments, which could lead to indirect injection if the source data is compromised.\n - Ingestion points: Evaluation reports and metadata are fetched in
scripts/manage_evals.pyfrom theresults.eval.all-hands.devCDN.\n - Boundary markers: Absent. The markdown report generated in
scripts/manage_evals.pydoes not use delimiters to isolate ingested data.\n - Capability inventory:
scripts/manage_evals.pycan perform network operations via the GitHub API to trigger workflows and post PR comments.\n - Sanitization: Absent. The script extracts and processes data fields from the fetched JSON without specific validation or escaping measures.
Audit Metadata