arize-evaluator
Pass
Audited by Gen Agent Trust Hub on Nov 4, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTION
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill ingests untrusted span data and experiment runs which are interpolated into LLM judge prompts. Ingestion points are identified in
ax spans exportandax experiments exportcommand workflows. The skill utilizes structured templates and binary classification labels as boundary markers. Capability inventory includes tool-mediated shell execution via theaxCLI and the execution of evaluation tasks. Sanitization is implemented via recommendations for low-temperature model settings and explicit instructions for the judge model's output format.\n- [DYNAMIC_EXECUTION]: The skill enables the creation of custom Python code evaluators. The agent is instructed to generate Python classes that subclass the vendor-providedCodeEvaluatorbase class. This dynamic execution surface is controlled through the use of specific class contracts and import requirements defined by the Arize platform, reducing the risk associated with arbitrary code generation.
Audit Metadata