llm-architect
Warn
Audited by Gen Agent Trust Hub on Aug 12, 2026
Risk Level: MEDIUMREMOTE_CODE_EXECUTIONCOMMAND_EXECUTIONPROMPT_INJECTION
Full Analysis
- [REMOTE_CODE_EXECUTION]: The script
scripts/finetune_model.pyutilizes thetrust_remote_code=Trueparameter withinAutoTokenizer.from_pretrainedandAutoModelForCausalLM.from_pretrained. This setting enables the execution of arbitrary Python code bundled with model files downloaded from remote repositories like the Hugging Face Model Hub, which can lead to code execution if the model repository is untrusted or compromised. - [PROMPT_INJECTION]: The skill implements a Retrieval-Augmented Generation (RAG) architecture in
REFERENCE.mdandscripts/setup_rag_pipeline.py, creating a surface for indirect prompt injection. - Ingestion points: Data is ingested from the local file system (e.g.,
./knowledge_base/) into vector databases (ChromaDB and Pinecone) inREFERENCE.mdandscripts/setup_rag_pipeline.py. - Boundary markers: The prompt templates in
REFERENCE.mduse basic instructional delimiters (e.g., "Answer the question using ONLY the provided sources") which are insufficient to prevent the agent from obeying malicious instructions embedded within retrieved document chunks. - Capability inventory: The skill includes powerful tools for model fine-tuning (
scripts/finetune_model.py), serving (scripts/serve_model.py), and infrastructure management, increasing the potential impact of a successful injection. - Sanitization: There is no evidence of content sanitization or validation of the retrieved text before it is interpolated into the generation prompt.
- [PROMPT_INJECTION]: The
REFERENCE.mdfile contains a security filtering functioncheck_safetywhich lists common prompt injection patterns like "ignore previous instructions" and "disregard all prior". While used defensively, these strings trigger security detectors for malicious instructional overrides. - [COMMAND_EXECUTION]: Multiple scripts within the skill (e.g.,
scripts/serve_model.py,scripts/benchmark_models.py,scripts/evaluate_model.py) are designed to be executed via the shell and perform operations such as managing Docker containers, spawning subprocesses, and modifying local system configurations.
Audit Metadata