llamafile

Installation
SKILL.md

Llamafile

Configure and manage Mozilla Llamafile - a cross-platform executable distribution format that runs LLMs locally with an OpenAI-compatible API.

When to Use This Skill

Use this skill when:

  • Installing llamafile binary and GGUF model files
  • Starting llamafile server with optimal configuration
  • Integrating llamafile with LiteLLM or OpenAI SDK
  • Configuring llamafile for different performance profiles (GPU, CPU, network access)
  • Troubleshooting llamafile server startup or API connection issues
  • Building applications requiring local LLM inference
  • Setting up commit message tools, code review systems, or other developer tools with local AI
  • Managing llamafile as a background service
  • Selecting and downloading appropriate GGUF models
  • Validating OpenAI-compatible API responses
Related skills

More from jamie-bitflight/claude_skills

Installs
8
GitHub Stars
44
First Seen
Mar 29, 2026