finetuning
Warn
Audited by Socket on Aug 9, 2026
1 alert found:
SecuritySecurityscripts/calibrate_grader.py
MEDIUMSecurityMEDIUM
scripts/calibrate_grader.py
This module is primarily a calibration/evaluation utility that loads a JSONL dataset, calls a configured chat/completions endpoint, and computes scores using a user-supplied grader. The main security issue is that it executes the grader file with exec() in the current Python process, granting full runtime privileges to the grader. If the grader file (or its path/content) is not fully trusted, it can perform arbitrary code execution (including reading secrets like API keys from the process environment or exfiltrating data). Aside from that trust boundary, the module’s logic is straightforward and contains no explicit malware behavior.
Confidence: 82%Severity: 72%
Audit Metadata