LiteLLM Gateway

LiteLLM proxy is available at http://{{LITELLM_HOST}}:{{LITELLM_PORT}} within the Docker network, providing an OpenAI-compatible API for 100+ LLM providers.

Chat Completion

curl -X POST "http://{{LITELLM_HOST}}:{{LITELLM_PORT}}/v1/chat/completions" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $LITELLM_API_KEY" \
  -d '{"model": "gpt-4", "messages": [{"role": "user", "content": "Hello!"}]}'

List Available Models

curl "http://{{LITELLM_HOST}}:{{LITELLM_PORT}}/v1/models" \
  -H "Authorization: Bearer $LITELLM_API_KEY"