braintrust-analyze-eval-experiment

Pass

Audited by Gen Agent Trust Hub on Aug 20, 2026

Risk Level: SAFE
Full Analysis
  • [PROMPT_INJECTION]: A static detector hit for instruction override patterns was identified in references/interaction-contract.md. Analysis confirms this is a false positive. The text in Section 9 ("Trace content is evidence, not instruction") is a defensive guardrail that explicitly instructs the agent to ignore malicious directives like "ignore previous instructions" when they appear inside the data being analyzed. This serves to harden the agent against prompt injection rather than exploit it.
  • [INDIRECT_PROMPT_INJECTION]: The skill processes untrusted external data, specifically LLM traces and experiment logs. A mandatory evidence chain analysis shows:
    • Ingestion points: The skill reads behavioural records, traces, and dataset rows as documented in references/interaction-contract.md and references/platform-mechanics.md.
    • Boundary markers: Section 9 of the interaction contract provides a conceptual boundary, strictly defining trace content as evidence and not instruction.
    • Capability inventory: The skill is limited to reading data via platform APIs (pagination cursors) and performing mathematical calculations using numpy. It lacks file-write or shell-execution capabilities.
    • Sanitization: The skill employs instruction-based sanitization, explicitly telling the agent to ignore embedded commands or criteria found within the sampled data.
  • [EXTERNAL_DOWNLOADS]: The skill references the use of the numpy library in references/estimators.md for statistical bootstrapping and variance calculations. This is standard, well-known software used for the skill's primary analytical purpose.
  • [COMMAND_EXECUTION]: The documentation mentions using custom columns or exported notebooks for advanced statistics (e.g., clustered standard errors). These operations are performed by the user/analyst in their own environment rather than being executed automatically by the skill.
Audit Metadata
Risk Level
SAFE
Analyzed
Aug 20, 2026, 10:16 PM