minicpm5-deploy-sglang

Installation

SKILL.md

Deploy MiniCPM5-1B with SGLang

OpenAI-compatible server with RadixAttention prefix cache. Best fit for tool calling, batched eval pipelines, and high-concurrency serving.

Var	Example	Default
`MODEL_PATH`	`openbmb/MiniCPM5-1B`	required
`PORT`	`30000`	`30000`
`GPU_ID`	`0`	`0`
`CTX_LEN`	`131072` (128 K)	`131072`
`MEM_FRAC`	`0.85`	`0.85`
`TOOL_PARSER`	`minicpm5`	`minicpm5`; use `auto` if you want template detection

Installs

Repository

GitHub Stars

10.5K

First Seen

Jun 1, 2026