Spice Workers

Workers coordinate model interactions, enabling load balancing and fallback strategies across multiple models.

Basic Configuration

workers:
  - name: <worker_name>
    type: load_balance
    description: |
      Worker description
    load_balance:
      routing:
        - from: <model_name>

Load Balancing Strategies