provider-architecture
Installation
SKILL.md
Provider Architecture Guide
Architecture Overview
LiteLLM-RS uses a Trait Object + Unified Error architecture optimized for 66+ LLM providers. This design prioritizes maintainability, compile time, and binary size over micro-optimizations.
Why Trait Objects Over Enum Dispatch
| Metric | Enum Dispatch | Trait Object | Winner |
|---|---|---|---|
| Method call latency | ~480ns | ~5,900ns | Enum |
| Binary size (66 providers) | ~50MB | ~10MB | Trait Object |
| Compile time | ~10 min | ~2 min | Trait Object |
| Runtime extensibility | No | Yes | Trait Object |
| Code maintainability | Poor | Excellent | Trait Object |
Key insight: 5μs dispatch overhead is negligible compared to 500ms-5000ms API latency (0.001%-0.01%).