inference-serving-sglang
Pass
Audited by Gen Agent Trust Hub on Nov 3, 2026
Risk Level: SAFEEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [EXTERNAL_DOWNLOADS]: The skill provides instructions to install the framework and specialized dependencies from established project repositories and specialized package indices. Examples include the official SGLang GitHub repository and the FlashInfer package index for high-performance CUDA kernels.\n
- Evidence: Installation commands like
pip install sglang[all] flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/andgit clone https://github.com/sgl-project/sglang.gitare found in SKILL.md.\n- [INDIRECT_PROMPT_INJECTION]: As a tool designed to process and serve LLM requests, the workflows naturally involve ingesting external data (e.g., user queries, articles, image paths), which creates an attack surface for indirect prompt injection.\n - Ingestion points: External data enters the context through variables such as
user_query,text,article, andnew_messageas seen in SKILL.md and references/structured-generation.md.\n - Boundary markers: The skill prominently features 'structured generation' as a core defense, using
json_schema,regex, andgrammarto strictly control and validate the model's output format.\n - Capability inventory: Capabilities include inference serving, multi-GPU processing, and reading multi-modal data (e.g., via
sgl.image).\n - Sanitization: The framework focuses on output validation; standard developer practices for input sanitization are assumed for production deployments.
Audit Metadata