Mistral Rate and Backpressure Control

Overview

Treat provider limits as shared workspace capacity, not constants. Admit work against measured demand, preserve deadlines and fairness, and shed load before retry storms consume remaining budget.

Prerequisites

• Current workspace request, token, and spend limits from the Admin Panel.
• Per-operation deadline, priority, idempotency, and maximum-attempt policy.
• Metrics for admitted, queued, throttled, retried, completed, and abandoned work.

Current Contract

Mistral documents workspace-shared limits across API keys and reports current dimensions in the Admin Panel. Limits vary; never encode a numeric example as a default.

Authentication

Limit telemetry excludes keys, prompts, responses, and files. Admin inspection requires separate authorized identity.