deployment
Pass
Audited by Gen Agent Trust Hub on Jul 6, 2026
Risk Level: SAFECOMMAND_EXECUTIONEXTERNAL_DOWNLOADSREMOTE_CODE_EXECUTION
Full Analysis
- [COMMAND_EXECUTION]: The skill makes extensive use of local shell scripts and system commands to manage inference servers and environment detection.
- The
scripts/deploy.shscript automates server lifecycle management (start, stop, status) and handles GPU discovery vianvidia-smi. - It utilizes tools like
ss,lsof, andpsto monitor port usage and process health. - [EXTERNAL_DOWNLOADS]: The skill fetches documentation, configuration recipes, and software packages from well-known technology providers and official repositories.
- Downloads inference recipes and cookbooks from the official GitHub repositories of vLLM and SGLang.
- Installs benchmarking and deployment frameworks (
vllm,sglang,tensorrt-llm,aiperf) via standard package managers. - References official Docker images from NVIDIA NGC and Docker Hub for containerized deployments.
- [REMOTE_CODE_EXECUTION]: The skill employs a pattern of piping network request outputs into a Python interpreter for data processing.
- Evidence: In
scripts/deploy.shandreferences/benchmarking.md, responses fromcurlcalls tohttp://localhost:8000/v1/modelsand/v1/chat/completionsare piped topython3 -cfor JSON parsing and output validation. - Context: These operations target the local inference endpoint just initialized by the user and are used exclusively for automated health checks and coherence gating during benchmarking.
- [DATA_EXFILTRATION]: The skill accesses local cluster configuration files to facilitate remote deployments via SSH or SLURM.
- Evidence: Accesses paths such as
~/.config/modelopt/clusters.yamland.agents/clusters.yaml. - Context: This access is scoped to identifying authorized remote environments for deployment and does not involve exfiltrating data to external domains.
Audit Metadata