test-harness
Pass
Audited by Gen Agent Trust Hub on Oct 11, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTIONEXTERNAL_DOWNLOADSCOMMAND_EXECUTION
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill provides a framework for testing AI agent harnesses by processing agent-generated content and tool inputs, which creates a surface for indirect prompt injection.
- Ingestion points: The
runHook(tool_inputparameter) andrunHarnessTest(transcriptparameter) functions inreferences/writing-tests.mdingest data that may originate from an AI agent or external source. - Boundary markers: Documentation in
references/writing-tests.mdhighlights the use of sandboxing for untrusted hooks ({ trusted: false }) and bubblewrap confinement. - Capability inventory: The
vigilesframework includes capabilities to execute shell commands and scripts viarunScript,runHook, andrunHarnessTestas described inSKILL.mdandreferences/writing-tests.md. - Sanitization: The skill describes the use of a bubblewrap-based sandbox to isolate execution, blocking unauthorized file writes and network egress for untrusted code.
- [DYNAMIC_EXECUTION]: The skill uses the
vigilesframework to execute shell scripts and hooks for testing purposes. - Evidence:
references/writing-tests.mdincludes examples of usingrunScriptto execute bash scripts (e.g.,bash scripts/check-links.sh). - Evidence:
references/writing-tests.mddemonstrates usingrunHookto execute hook commands derived from the project under test. - [EXTERNAL_DOWNLOADS]: The skill involves downloading dependencies and referencing external CI components.
- Evidence:
SKILL.mdinstructs the user to install thevigilesand@anthropic-ai/claude-codepackages via NPM. - Evidence:
SKILL.mdreferences thezernie/vigiles@v1GitHub Action for use in CI workflows. - [COMMAND_EXECUTION]: The skill documentation provides commands to run the testing and evaluation tools.
- Evidence:
SKILL.mdspecifies the use ofnpx vigiles testandnpx vigiles evalto perform test runs and model evaluations.
Audit Metadata