vllm-bench-random-synthetic
Pass
Audited by Gen Agent Trust Hub on Sep 14, 2026
Risk Level: SAFECOMMAND_EXECUTIONEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [COMMAND_EXECUTION]: The skill uses standard command-line tools for benchmarking and process management.
- Executes
vllm serveto start the inference engine. - Executes
vllm bench serveto initiate the performance measurement. - Uses
curlfor health checks andkillfor process cleanup, which are standard administrative actions for this use case. - [EXTERNAL_DOWNLOADS]: The skill references the installation of the
vllmpackage via pip. - vLLM is a widely recognized, open-source library for high-throughput LLM serving.
- The models referenced (e.g., Qwen, Llama, OPT) are standard models hosted on HuggingFace, typical for benchmarking tasks.
- [INDIRECT_PROMPT_INJECTION]: The skill interacts with LLM endpoints by sending synthetic prompts.
- Ingestion points: The
--dataset-name randomparameter invllm bench servegenerates synthetic data internally (SKILL.md). - Boundary markers: Standard CLI argument structure.
- Capability inventory: Includes starting/stopping server processes and making local network requests (curl).
- Sanitization: The skill relies on the
vllmtool's internal handling of synthetic data generation.
Audit Metadata