minicpm5-finetune-unsloth

Installation
SKILL.md

Fine-tune MiniCPM5-1B with unsloth

Single-GPU LoRA / QLoRA. Heavy custom kernels for memory savings (~2× reduction at 4-bit).

⚠️ Two install-time pins (read this BEFORE running):

  1. transformers==4.57.3 — required if vLLM is in the same env (unsloth's vLLM coexistence patch only handles transformers ≤ 4.57.x).
  2. torch==2.7.1 + torchvision==0.22.1pip install unsloth may pull a cu13 torch wheel that fails on cu12.x drivers (cuda.is_available() returns False).
pip install --force-reinstall "torch==2.7.1" "torchvision==0.22.1" "transformers==4.57.3"

Required input

Installs
1
Repository
openbmb/minicpm
GitHub Stars
10.5K
First Seen
Jun 1, 2026
minicpm5-finetune-unsloth — openbmb/minicpm