arize-prompt-optimization
Pass
Audited by Gen Agent Trust Hub on Oct 17, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONDATA_EXFILTRATION
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill implements a data-driven optimization loop that ingests untrusted LLM outputs and production traces to generate revised system prompts. This creates a surface for indirect prompt injection where malicious instructions embedded in production data could influence the agent's prompt generation logic.
- Ingestion points: Production trace data is retrieved via
ax spans export, and experiment results are gathered viaax datasets exportandax experiments export. - Boundary markers: The meta-prompt template in
references/optimization-meta-prompt.mduses structured headers such asORIGINAL BASELINE PROMPTandPERFORMANCE DATAto separate instructions from data, though these are not cryptographically secure. - Capability inventory: The skill utilizes the
axCLI for data retrieval,jqfor JSON processing, and shell redirection to write trace data to local files (e.g.,spans.json). - Sanitization: The instructions do not specify sanitization or escaping of the ingested trace data before it is interpolated into the optimization template.
- [COMMAND_EXECUTION]: The skill frequently executes shell commands, specifically the
axCLI tool andjq, to manage Arize profiles and process production data. These are standard operations for the skill's purpose. - [DATA_EXFILTRATION]: The skill exports production spans and experiment results to the local filesystem. This is a primary function for prompt debugging and optimization within the Arize ecosystem.
Audit Metadata