agent-eval
Warn
Audited by Gen Agent Trust Hub on Mar 26, 2026
Risk Level: MEDIUMCOMMAND_EXECUTIONEXTERNAL_DOWNLOADSREMOTE_CODE_EXECUTIONPROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The skill instructs the agent to run a CLI tool (
agent-eval) which in turn executes shell commands defined in thejudgesection of YAML task files (e.g.,pytest,npm run build). - [EXTERNAL_DOWNLOADS]: The skill references an external repository (
github.com/joaquinhuigomez/agent-eval) for the installation of the evaluation tool. This repository is not from a known trusted organization. - [REMOTE_CODE_EXECUTION]: By executing the
agent-evaltool and processing external YAML task definitions, there is a risk of remote code execution if the task files or the tool itself are malicious. - [PROMPT_INJECTION]: The skill processes untrusted YAML task definitions which include
promptandjudgecommands, creating an indirect prompt injection surface. * Ingestion points: YAML files in thetasks/directory. * Boundary markers: None identified in the provided instructions. * Capability inventory: Execution of arbitrary shell commands via theBashtool during the evaluation judge phase. * Sanitization: No validation or sanitization of the commands or prompts within the YAML files is described.
Audit Metadata