skill-eval-loop
Audited by Socket on Sep 21, 2026
3 alerts found:
Anomalyx2SecurityThe code appears to be a verification and blind-comparison harness, not intentionally malicious. Its main security concern is deliberate execution of an unvalidated brief-supplied shell command with inherited environment variables, which is dangerous when briefs or run directories are untrusted. The incomplete JUDGE_PROMPT assignment makes the supplied fragment non-executable. No direct credential theft, persistence, destructive behavior, or obfuscated malware is evident.
The code is a task-generation utility with a high-impact dynamic execution boundary in knowledge-gap mode. LLM-generated verify_py is executed via bash with the current user's privileges, so a malicious model response, prompt-injection result, or compromised forge_llm implementation could execute arbitrary commands. Context files are also sent to the configured model. The fragment shows no explicit credential theft, persistence, destructive behavior, or network exfiltration, but it should be treated as unsafe when model output or input JSON is untrusted. The shown syntax is incomplete and would fail to import as provided.
This is a legitimate deployment and verification script with no clear malware indicators. It has a medium-severity command-injection risk in the remote mode because REMOTE_ROOT and skill names are inserted into ssh command strings without robust shell escaping. Restrict these values to validated path components and use safe argument passing or quoted remote scripts. Confidence is high for the findings; malicious intent is unlikely.