Together AI Dynamic Rate Limits

Overview

This skill replaces fixed quota tables with adaptive control driven by Together's current response headers and observed workload demand.

Prerequisites

• The exact model IDs and traffic profile by request and token volume
• Access to response headers from the HTTP or SDK transport
• Queue-latency, retry, spend, and failure budgets
• A decision owner for batch, provisioned, or dedicated capacity

Tool Discipline

Use Read, Glob, and Grep to locate concurrency, queue, retry, and telemetry code. Use WebFetch for the current dynamic-limit header contract. Use Write or Edit only after the target limiter and tests are identified.

Current Contract