LiteLLM Proxy

OpenAI-compatible API gateway routing to 100+ LLM providers with unified auth, spend tracking, rate limiting, and observability.

Quick Start

# Docker (stable)
docker run -v $(pwd)/config.yaml:/app/config.yaml \
  -e LITELLM_MASTER_KEY=sk-1234 \
  -e DATABASE_URL=postgresql://user:pass@host:5432/litellm \
  -p 4000:4000 \
  docker.litellm.ai/berriai/litellm:main-stable \
  --config /app/config.yaml

# Helm
helm install litellm oci://docker.litellm.ai/berriai/litellm-helm