agent-evaluation

Warn

Audited by Socket on Oct 8, 2026

1 alert found:

Anomaly
AnomalyLOW
scripts/run_evaluation_template.py

No clear malware or intentional supply-chain attack is present. The code appears to be an MLflow evaluation script generator, but it has significant code-generation safety issues: unvalidated values are inserted into executable Python, and the output path can overwrite a user-selected file. The fragment also contains syntax errors and an incomplete subprocess command. Review and fix before use, especially by validating identifiers, escaping generated literals, restricting output paths, and avoiding subprocess-based dataset discovery.

Confidence: 97%Severity: 62%
Audit Metadata
Analyzed At
Oct 8, 2026, 02:08 PM
Package URL
pkg:socket/skills-sh/mlflow%2Fskills%2Fagent-evaluation%2F@c539a20cea3f85ef1f829cd82a6fef99e6b77535c8e003ffbb0735e4c7cdffcb