ragas-evaluation

Warn

Audited by Socket on Nov 1, 2026

1 alert found:

Security
SecurityMEDIUM
evals/forty-one-correct-queries-failing-the-sql-gate/task.md

No evidence of malware or intentional malicious behavior appears in the provided fragment. There is a meaningful security weakness in the SQL evaluation gate: a superficial tenant_id text check and a single-tenant fixture can allow unscoped generated queries to pass without demonstrating tenant isolation. The documented production examples show this risk materializing. Use multi-tenant fixtures and enforce tenant predicates semantically or through a suitably restricted execution context.

Confidence: 98%Severity: 72%
Audit Metadata
Analyzed At
Nov 1, 2026, 08:27 AM
Package URL
pkg:socket/skills-sh/testland%2Fqa%2Fragas-evaluation%2F@066e8d5f17b839335e051f168780dca329d6c50de71f3583627e7e56bdbb4aa4