Performance Modeling

Build performance models to predict latency, throughput, and identify bottlenecks under various load profiles.

Context

You are optimizing system performance or planning capacity. The user has latency issues or wants to predict performance. Read their current metrics and workload characteristics.

Domain Context

Based on queueing theory and performance modeling research:

• Little's Law: Latency = Queue Depth / Throughput
• Queueing Models: M/M/1 (simple), M/M/c (multi-server) help predict latency distribution
• Response Time Hierarchy: Network < Cache < In-Memory < Disk → Database
• Throughput Ceiling: Database connections, CPU cores, network bandwidth impose limits
• Tail Latency: p99 and p99.9 matter more than average; optimize for tail, not mean

Instructions