kelly-local-model-lab
Pass
Audited by Gen Agent Trust Hub on Oct 9, 2026
Risk Level: SAFECOMMAND_EXECUTIONINDIRECT_PROMPT_INJECTIONEXTERNAL_DOWNLOADS
Full Analysis
- [COMMAND_EXECUTION]: The script
scripts/mlx_smoke.pyusessubprocess.runto invoke themlx_lmtraining module. This is the primary function of the skill, used to perform local model fine-tuning on Apple Silicon. - [INDIRECT_PROMPT_INJECTION]: The skill ingests training data from external sources (Busabase and Kelly Support). While this data is processed by the agent, the skill implements multiple security controls:
- Mandatory human review and approval steps in the workflow (
approve,request_changes,block). - Strict schema validation for
app_spectasks to ensure data follows expected JSON structures. - Deterministic evaluation using locked test datasets to measure model performance accurately.
- [EXTERNAL_DOWNLOADS]: The skill manages dependencies via standard package managers and fetches model weights from Hugging Face through the
mlx-lmlibrary, which is consistent with its purpose as a model training lab.
Audit Metadata