TokenOptimizer

When to Use

• You have a coding task and want to send it to an LLM API with less context (fewer tokens, lower cost).
• You want automatic fallback from a cheap provider to a more capable one when credits run out.
• You want local LLM preprocessing to score relevance and compress context before it hits a paid API.
• You need to stay within a token budget while keeping the most important context.

Quick Start

# Optimize a prompt with default strategies
token_optimizer optimize --input "Fix the bug in auth" --context src/auth.rs

# Analyze cache potential for Anthropic
token_optimizer cache-optimize --task "Add feature" --context types.rs --static-indices "0"