ai-test-generator
Pass
Audited by Gen Agent Trust Hub on Oct 2, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONDYNAMIC_EXECUTION
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill processes external acceptance criteria from YAML files through an LLM to generate code, creating a potential surface for indirect prompt injection.
- Ingestion points: Acceptance criteria are read from files like
input/cart-promo.yamland passed to the LLM inscripts/ai-gen.py. - Boundary markers: The skill uses a fixed system prompt to constrain LLM behavior, though it does not use explicit delimiters for the input data.
- Capability inventory: The skill writes generated code to the filesystem and executes syntax validation commands.
- Sanitization: Includes a heuristic-based confidence scoring rubric and a mandatory human-in-the-loop review process before merging.
- [COMMAND_EXECUTION]: The skill executes shell commands to perform syntax and compilation checks on generated test files.
- Evidence:
npx tsc --noEmit,python -m py_compile, andnode --checkare used in the validation step defined inSKILL.md. - [DYNAMIC_EXECUTION]: The skill generates source code files and dynamically checks for the existence of modules at runtime.
- Evidence: The
save_testfunction inreferences/generation-and-scoring.mdwrites string content from the LLM to.jsor.pyfiles. - Evidence: The
module_existshelper function usesimportlib.util.find_specto check if modules imported in the generated code are present in the environment.
Audit Metadata