LiteLLM Documentation

Official docs for LiteLLM — call 100+ LLM APIs using the OpenAI format (Python SDK + Proxy Server).

CRITICAL: grep references/ for keywords before answering.

Reference Index (664 docs)

Providers (170 docs)

• references/providers/ — Provider-specific guides for OpenAI, Anthropic, Azure, AWS Bedrock, Google Vertex AI, Gemini, Cohere, Mistral, Groq, Together AI, Fireworks, Deepseek, Ollama, vLLM, Hugging Face, Replicate, Perplexity, Cerebras, Sambanova, xAI, and 80+ more

Proxy Server (168 docs)

• references/proxy/ — LiteLLM Proxy (OpenAI-compatible gateway)
  • Config, deployment (Docker, Kubernetes, Helm)
  • Virtual keys, spend tracking, budgets, rate limiting
  • Load balancing, fallbacks, routing, model groups
  • SSO/RBAC, audit logs, guardrails, content moderation
  • UI dashboard, team management, tag-based routing