specialized-model-qa

Pass

Audited by Gen Agent Trust Hub on Nov 8, 2026

Risk Level: SAFEINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTION
Full Analysis
  • [INDIRECT_PROMPT_INJECTION]: The skill is designed to ingest and process external, untrusted data including model methodology documents, datasets, and label definitions. This creates a surface for indirect prompt injection where malicious instructions embedded in the audited data could influence the agent's behavior during the audit pipeline.
  • Ingestion points: Data reconstruction (SKILL.md), Target / Label Analysis (SKILL.md), and Feature Analysis (SKILL.md) sections involve processing external data structures.
  • Boundary markers: No explicit instructions are provided to the agent to treat audited data strictly as content and ignore potential instructions within it.
  • Capability inventory: The skill has the capability to write files and execute code via the shell (SKILL.md, run.sh), which increases the potential impact of an injection.
  • Sanitization: There are no documented steps for sanitizing or filtering instructions from the external data.
  • [DYNAMIC_EXECUTION]: The skill's core functionality requires the dynamic generation and execution of scripts to replicate model training pipelines and perform statistical tests.
  • Evidence: The skill includes a 'Reproducibility Standard' requiring that 'Every analysis must be fully reproducible' and 'Scripts must be versioned and self-contained' (SKILL.md). It also provides several Python templates for metrics and interpretability that are intended to be executed at runtime.
  • Execution Mechanism: The agent is instructed to 'Reproduce model training pipeline from documented specifications', which involves generating and running code based on external inputs.
Audit Metadata
Risk Level
SAFE
Analyzed
Nov 8, 2026, 10:48 PM