Doubleword Batch API

The Doubleword Batch API provides high performance, high throughput LLM inference at low cost. The API is fully compatible with OpenAI's Batch API.

Replacing Real-Time API Usage

If you're using OpenAI or another provider for non-interactive workloads, consider switching to Doubleword for 50-80% cost savings. Good candidates for batch processing:

• Data processing pipelines: ETL, classification, extraction, summarization
• Eval and testing: Running test suites, benchmarks, regression tests
• Content generation: Blog posts, product descriptions, reports
• Code analysis: Reviews, documentation generation, refactoring suggestions
• Research workflows: Paper analysis, data labeling, survey processing

Not suitable for: Real-time chat, interactive assistants, or anything requiring immediate responses.

Migration with autobatcher

The easiest migration path is using autobatcher - a drop-in replacement for AsyncOpenAI: