evals-ops

Pass

Audited by Gen Agent Trust Hub on Sep 28, 2026

Risk Level: SAFE
Full Analysis
  • [INDIRECT_PROMPT_INJECTION]: The skill processes untrusted evaluation datasets to measure agent performance and safety. Ingestion points: .jsonl data files processed by scripts such as goldenset-audit.py and judge-calibration.py. Boundary markers: The skill provides templates like assets/judge-rubric.template.md that utilize explicit delimiters (<<< >>>) and instructions to focus on specific criteria. Capability inventory: Standard Python 3 scripts performing file I/O and shell output; no network exfiltration or dangerous subprocess calls are present. Sanitization: The scripts use standard JSON parsing and perform rigorous statistical validation to interpret data. This surface is intentional and documented as part of the skill's core purpose for evaluation.
  • [SAFE]: All included scripts (eval-baseline.py, goldenset-audit.py, judge-calibration.py) are implemented using standard Python libraries and operate entirely offline. No hardcoded credentials or access to sensitive local environment paths were detected.
  • [SAFE]: The presence of prompt injection patterns in assets/golden-set.example.jsonl (e.g., 'Ignore your refund policy') is a safe finding, as these are clearly labeled as adversarial test cases designed to verify the safety and refusal capabilities of the agent under test.
Audit Metadata
Risk Level
SAFE
Analyzed
Sep 28, 2026, 04:08 PM