run-and-babysit-eval

Pass

Audited by Gen Agent Trust Hub on Nov 5, 2026

Risk Level: SAFEREMOTE_CODE_EXECUTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
  • [REMOTE_CODE_EXECUTION]: Installs the uv package manager by fetching an installation script from the official astral.sh domain and executing it via a shell pipe. This is the standard, documented installation method for this well-known development tool.
  • [EXTERNAL_DOWNLOADS]: Downloads the NeMo Gym repository from the vendor's official GitHub organization (github.com/NVIDIA-NeMo/Gym.git) to set up the evaluation environment.
  • [COMMAND_EXECUTION]: Automates the submission and management of Slurm jobs through the gym CLI, including environment provisioning, dependency installation via uv pip install, and job lifecycle control commands like sbatch and scancel.
  • [INDIRECT_PROMPT_INJECTION]: The skill processes external data such as evaluation configurations (submit.yaml) and results files (rollouts.jsonl).
  • Ingestion points: Reads configurations and result logs from the run directory.
  • Boundary markers: Uses validation flags like --resolve-only and --dry-run to verify configurations before they influence the environment.
  • Capability inventory: Performs file writes for logging, executes shell commands for job management, and interacts with Slurm APIs.
  • Sanitization: Leverages the gym CLI's internal schema validation and resolution logic to ensure data integrity.
Audit Metadata
Risk Level
SAFE
Analyzed
Nov 5, 2026, 02:47 PM