skill-eval-builder

Warn

Audited by Socket on Aug 9, 2026

1 alert found:

Security
SecurityMEDIUM
scripts/run-evals.py

No clear evidence of embedded malware payloads (e.g., backdoors, exfiltration logic, crypto-mining) is present in the visible code. However, the script contains a high-impact design flaw: it executes shell commands with shell=True where the command strings come directly from untrusted Markdown fields (validate and fired_when). In a supply-chain context where cases.md could be tampered with, this becomes an arbitrary command execution (RCE) vector. Treat this tool as unsafe unless the cases file and related inputs are fully trusted and locked down.

Confidence: 78%Severity: 86%
Audit Metadata
Analyzed At
Aug 9, 2026, 04:14 PM
Package URL
pkg:socket/skills-sh/devclarityai%2Fdevclarity-marketplace%2Fskill-eval-builder%2F@ae6b1d0ece2f1be5e2a88ce2d28fd56a2e561470aaa008a84baf6df713d467f3
Security Audit — socket — skill-eval-builder