Docker Model Runner

Docker Model Runner (DMR) makes it easy to run AI models locally using Docker. This skill helps you effectively use Docker Model Runner for local LLM inference in your development workflow.

Workflow

When helping users with local LLM inference using Docker Model Runner:

1. Check if Docker Model Runner is available by running docker model version

2. List available models with docker model list to see what's already pulled

3. Search for models on Docker Hub or HuggingFace:

   • docker model search <query> to find models
   • Popular models include: ai/gemma3, ai/llama3.2, ai/smollm2, ai/qwen3

4. Pull models before running: docker model pull <model>