run-and-babysit-eval
Pass
Audited by Gen Agent Trust Hub on Nov 5, 2026
Risk Level: SAFEREMOTE_CODE_EXECUTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [REMOTE_CODE_EXECUTION]: Installs the
uvpackage manager by fetching an installation script from the officialastral.shdomain and executing it via a shell pipe. This is the standard, documented installation method for this well-known development tool. - [EXTERNAL_DOWNLOADS]: Downloads the NeMo Gym repository from the vendor's official GitHub organization (
github.com/NVIDIA-NeMo/Gym.git) to set up the evaluation environment. - [COMMAND_EXECUTION]: Automates the submission and management of Slurm jobs through the
gymCLI, including environment provisioning, dependency installation viauv pip install, and job lifecycle control commands likesbatchandscancel. - [INDIRECT_PROMPT_INJECTION]: The skill processes external data such as evaluation configurations (
submit.yaml) and results files (rollouts.jsonl). - Ingestion points: Reads configurations and result logs from the run directory.
- Boundary markers: Uses validation flags like
--resolve-onlyand--dry-runto verify configurations before they influence the environment. - Capability inventory: Performs file writes for logging, executes shell commands for job management, and interacts with Slurm APIs.
- Sanitization: Leverages the
gymCLI's internal schema validation and resolution logic to ensure data integrity.
Audit Metadata