microsoft-foundry
Audited by Socket on Sep 25, 2026
2 alerts found:
SecurityAnomalyThis module is primarily a calibration/evaluation utility that loads a JSONL dataset, calls a configured chat/completions endpoint, and computes scores using a user-supplied grader. The main security issue is that it executes the grader file with exec() in the current Python process, granting full runtime privileges to the grader. If the grader file (or its path/content) is not fully trusted, it can perform arbitrary code execution (including reading secrets like API keys from the process environment or exfiltrating data). Aside from that trust boundary, the module’s logic is straightforward and contains no explicit malware behavior.
No direct malware or deliberate malicious payload is evident in the supplied documentation. The configuration creates a meaningful security exposure by trusting a public unauthenticated MCP server and, in the declarative example, disabling approval for tool calls. Review and constrain the remote server's tools, use authentication where supported, and avoid require_approval: never for sensitive operations.