skill-eval-builder
Warn
Audited by Socket on Aug 9, 2026
1 alert found:
SecuritySecurityscripts/run-evals.py
MEDIUMSecurityMEDIUM
scripts/run-evals.py
No clear evidence of embedded malware payloads (e.g., backdoors, exfiltration logic, crypto-mining) is present in the visible code. However, the script contains a high-impact design flaw: it executes shell commands with shell=True where the command strings come directly from untrusted Markdown fields (validate and fired_when). In a supply-chain context where cases.md could be tampered with, this becomes an arbitrary command execution (RCE) vector. Treat this tool as unsafe unless the cases file and related inputs are fully trusted and locked down.
Confidence: 78%Severity: 86%
Audit Metadata