skill-eval-loop
Pass
Audited by Gen Agent Trust Hub on Jul 5, 2026
Risk Level: SAFE
Full Analysis
- [COMMAND_EXECUTION]: The skill instructs the agent to use local Python scripts (
scripts/skillctl.pyandscripts/install-external-skills.py) for operational tasks. These include classifying differences in code, proposing upstream patches, and managing external skill installations. - [EXTERNAL_DOWNLOADS]: The skill facilitates the installation of external AI agent skills (such as
writing-great-skillsorteach) through a local registry and installation script. This is standard functionality for skill management within this ecosystem. - [CREDENTIALS_UNSAFE]: The skill metadata (
.skillmeta.yml) and instructions include explicit protections against credential exposure. Files such aspersonalize.local.yml,*.local.yml, and directories like.company/or.user/are marked as forbidden for upstream contributions to ensure private user and environment data remain local. - [INDIRECT_PROMPT_INJECTION]: The skill acts as a mutation and evaluation engine for other prompts, which inherently creates an attack surface for processing potentially malicious instructions.
- Ingestion points: Processes skill diffs and mutation proposals via
scripts/skillctl.pyand evaluates skill behavior using user-provided eval sets. - Boundary markers: The documentation in
references/skill-eval-methods.mdmandates strict human-in-the-loop approval gates, regression checks, and evidence-based shipping criteria to mitigate the risk of unintended behavior changes. - Capability inventory: Execution is scoped to Python-based helper scripts for diffing, patching, and installation.
- Sanitization: Relies on human oversight and explicit regression gates rather than automated sanitization, which is appropriate for a development-focused evaluation loop.
Audit Metadata