finetuning

Warn

Audited by Socket on Aug 9, 2026

1 alert found:

Security
SecurityMEDIUM
scripts/calibrate_grader.py

This module is primarily a calibration/evaluation utility that loads a JSONL dataset, calls a configured chat/completions endpoint, and computes scores using a user-supplied grader. The main security issue is that it executes the grader file with exec() in the current Python process, granting full runtime privileges to the grader. If the grader file (or its path/content) is not fully trusted, it can perform arbitrary code execution (including reading secrets like API keys from the process environment or exfiltrating data). Aside from that trust boundary, the module’s logic is straightforward and contains no explicit malware behavior.

Confidence: 82%Severity: 72%
Audit Metadata
Analyzed At
Aug 9, 2026, 06:16 AM
Package URL
pkg:socket/skills-sh/microsoft%2Fazure-skills%2Ffinetuning%2F@f458e8ca9aa91aa7c7a79bc78d6f2e93e401d3bcac54866b405141631eca5382
Security Audit — socket — finetuning