minicpm5-deploy-lmstudio
Installation
SKILL.md
Deploy MiniCPM5-1B with LM Studio
Desktop GUI + OpenAI-compatible local server. On Apple Silicon ships two runtimes:
| Runtime | Format | When to use |
|---|---|---|
| GGUF (llama.cpp engine) | F16 / Q8_0 / Q4_K_M | cross-platform, same artifact as Ollama; Q4_K_M build |
| MLX (Apple Silicon only) | bf16 / 4-bit | ~60 % faster, automatic think/answer split via reasoning_content; Q4 build |
Required input
| Var | Example | Default |
|---|---|---|
| Runtime | gguf or mlx |
mlx on Apple Silicon, gguf elsewhere |
QUANT |
Q4_K_M (GGUF) or 4bit (MLX) |
Q4_K_M / 4bit |
MODEL_NAME |
minicpm5-1b |
minicpm5-1b |