vllm-sota-humanize-loop
Pass
Audited by Gen Agent Trust Hub on Aug 28, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONDYNAMIC_EXECUTIONCOMMAND_EXECUTION
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill processes model PR history and framework source code (vLLM, SGLang) to influence its autonomous patching decisions. This creates a surface where adversarial instructions in external documentation or code comments could redirect the agent's behavior.
- Ingestion points: Reads
model-pr-optimization-historyand source code fromvLLMandSGLangto populate history notes as described inSKILL.md(Phase 0.5). - Boundary markers: The instructions do not specify any delimiters or safety warnings to distinguish between data and instructions when reading these external sources.
- Capability inventory: The skill has the ability to patch source code (Python, C++, CUDA, Triton) and execute shell commands for benchmarking and profiling.
- Sanitization: There is no mention of filtering or validating the ingested content.
- [DYNAMIC_EXECUTION]: The skill autonomously modifies and executes
vLLMsource code to improve performance. - Evidence: The RLCR loop involves patching files in
csrc/,vllm/, andvllm/compilation/, then runningvllm serveto benchmark the modified code. - Computed Paths: It executes
scripts/setup-rlcr-loop.shfrom a path determined by the$HUMANIZE_RUNTIME_ROOTenvironment variable. - [COMMAND_EXECUTION]: The skill runs various performance benchmarking and profiling tools.
- Evidence: Executes
vllm serve,python -m sglang.launch_server,trtllm-serve serve --backend pytorch, and various internal scripts likescripts/query.pyandscripts/setup-rlcr-loop.sh.
Audit Metadata