promptfoo-evaluation

Warn

Audited by Socket on Nov 1, 2026

1 alert found:

Anomaly
AnomalyLOW
evals/safety-gate-has-not-gone-red-since-march/task.md

The fragment shows a safety gate that reported concrete PII and cross-customer assertion failures while still returning a successful job and green merge check. This is a significant safety-gate effectiveness concern, but the omitted Promptfoo configuration prevents determining whether it is caused by configuration, reporting, or intentional bypass. No direct malware or exfiltration is visible. The workflow also has exposure and reproducibility risks from running pull-request-controlled content with secrets available and using an unpinned npx invocation.

Confidence: 91%Severity: 68%
Audit Metadata
Analyzed At
Nov 1, 2026, 08:27 AM
Package URL
pkg:socket/skills-sh/testland%2Fqa%2Fpromptfoo-evaluation%2F@7f2bf8eefb9c2e00e4babdf26509347d07d1aab24699cc2d552ee70d9384df84