systematic-debugging
Pass
Audited by Gen Agent Trust Hub on Jul 10, 2026
Risk Level: SAFEDATA_EXFILTRATIONCOMMAND_EXECUTIONPROMPT_INJECTION
Full Analysis
- [DATA_EXFILTRATION]: The skill's diagnostic examples in
SKILL.mdandroot-cause-tracing.mdinstruct the agent to run commands likesecurity list-keychainsandsecurity find-identity -v(on macOS) during Phase 1 (Root Cause Investigation). While intended for debugging signing and credential issues, these commands expose sensitive system-level metadata and identity information to the agent's execution context. - [COMMAND_EXECUTION]: The skill includes a bash script
find-polluter.shwhich executesnpm teston files identified through user-provided patterns. Furthermore, the instructions inSKILL.mdprovide examples for executing tools such ascodesign,git init, and other CLI utilities. This represents a capability surface where the agent performs local command execution to fulfill debugging tasks. - [INDIRECT_PROMPT_INJECTION]: The skill is designed to ingest and analyze potentially untrusted external data such as error messages and stack traces.
- Ingestion points:
SKILL.mdPhase 1 explicitly directs the agent to "Read Error Messages Carefully" and "Read stack traces completely." - Boundary markers: There are no instructions provided to wrap this external content in delimiters or to use "ignore embedded instructions" warnings.
- Capability inventory: The skill has access to shell execution (
npm,git,security) and file system operations (ls,find). - Sanitization: The process does not include steps to sanitize or validate the content of error logs or stack traces before they are processed by the agent.
- [PROMPT_INJECTION]: The evaluation files
test-pressure-1.md,test-pressure-2.md, andtest-pressure-3.mdutilize forceful language ("IMPORTANT: This is a real scenario", "You must choose and act", "make the actual decision") and role-play ("You're the on-call engineer"). Although these are intended as a testing suite to verify the agent's adherence to the debugging process, the patterns mirror instruction override and jailbreak simulation techniques.
Audit Metadata