Together AI Batch Inference

Overview

This skill converts independent offline requests into a recoverable Batch API job and reconciles every success and failure without relying on output order.

Prerequisites

• Independent request records suitable for asynchronous processing
• A currently batch-eligible model and supported endpoint
• Stable unique custom_id values and an approved output location
• A request/token budget, retention policy, and job owner

Tool Discipline

Use Read, Glob, and Grep to inspect input generation, schemas, and reconciliation code. Use WebFetch for current batch eligibility and SDK response shapes. Use Write or Edit only for approved JSONL, manifests, or reconciliation logic; avoid placing sensitive prompts in diagnostic output.

Current Contract