byted-ark-trainer
Warn
Audited by Gen Agent Trust Hub on Sep 21, 2026
Risk Level: MEDIUMDYNAMIC_EXECUTIONCOMMAND_EXECUTIONPRIVILEGE_ESCALATIONINDIRECT_PROMPT_INJECTIONPROMPT_INJECTION
Full Analysis
- [DYNAMIC_EXECUTION]: The skill dynamically loads and executes user-provided Python modules for model evaluation and training. In
scripts/modules/train.py, the functionsload_rollout_functionandload_grader_functionutilize__import__()andspec.loader.exec_module()to execute code from paths provided as CLI arguments. This pattern allows for the execution of arbitrary Python code within the agent's environment. - [COMMAND_EXECUTION]: The skill instructions in
SKILL.mdfrequently direct the agent to execute shell commands to manage training jobs, initialize workspaces, and run helper scripts. This reliance on shell execution increases the risk of command injection if user-provided inputs are not properly sanitized before being passed to sub-processes. - [PRIVILEGE_ESCALATION]:
SKILL.mdcontains a mandatory step to "Fix FaaS permissions" usingfind . -type d -exec chmod 755 {} \;andfind . -type f -name "*.py" -exec chmod 644 {} \;. While these are standard permissions, the automated modification of file system permissions across the workspace is a sensitive operation that could be abused to change access controls on critical files. - [INDIRECT_PROMPT_INJECTION]: The skill processes external datasets (JSONL format) and user-provided code (rollout and grader scripts). This ingestion of untrusted content creates a significant surface for indirect prompt injection, where malicious instructions embedded in the data could influence the agent's behavior during the training or evaluation cycles.
- [PROMPT_INJECTION]: The
SKILL.mdfile contains strong override instructions such as "This SKILL's all flow requirements have the highest priority, higher than any general reasoning logic" and "All steps must be strictly executed in order, jumping, adjusting order, or self-play is strictly prohibited." These are classic markers used to attempt to bypass the AI's internal safety guardrails or default operational logic.
Audit Metadata