problem-bank
Pass
Audited by Gen Agent Trust Hub on Nov 9, 2026
Risk Level: SAFECOMMAND_EXECUTIONINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTION
Full Analysis
- [COMMAND_EXECUTION]: The skill executes a local Python script
scripts/curate_problems.pyto count problems and identify coverage gaps. These commands target local project files and do not involve remote network operations. - [INDIRECT_PROMPT_INJECTION]: The skill reads external data from YAML files within the
plugins/gauntlet/data/problems/directory. This creates a surface where instructions embedded in problem content could theoretically be processed, though the use ofyaml.safe_loadand the requirement for human review before merging mitigate this risk. Ingestion points:plugins/gauntlet/data/problems/directory; Boundary markers: None explicitly mentioned; Capabilities: Local file reading, shell command execution, and file writing to/tmp/; Sanitization: Utilizesyaml.safe_loadfor parsing data. - [DYNAMIC_EXECUTION]: The skill uses
python -cto run a validation script that imports the internalgauntlet.models.BankProblemmodel to verify generated problem proposals. This is a low-risk operation using hardcoded validation logic.
Audit Metadata