ragas-evaluation
Warn
Audited by Socket on Nov 1, 2026
1 alert found:
SecuritySecurityevals/forty-one-correct-queries-failing-the-sql-gate/task.md
MEDIUMSecurityMEDIUM
evals/forty-one-correct-queries-failing-the-sql-gate/task.md
No evidence of malware or intentional malicious behavior appears in the provided fragment. There is a meaningful security weakness in the SQL evaluation gate: a superficial tenant_id text check and a single-tenant fixture can allow unscoped generated queries to pass without demonstrating tenant isolation. The documented production examples show this risk materializing. Use multi-tenant fixtures and enforce tenant predicates semantically or through a suitably restricted execution context.
Confidence: 98%Severity: 72%
Audit Metadata