Low Latency Systems

Use this skill to turn latency incidents and regressions into measurable, reproducible fixes.

Workflow

1. Lock measurement context first.

• Capture workload, concurrency, payload sizes, warmup policy, and hardware/runtime settings.
• Keep baseline and current runs environment-compatible.

2. Decompose latency path.

• Split end-to-end latency into ingress, queue, compute, storage/network, and egress components.
• Prioritize tail-latency contributors over average-only improvements.

3. Apply targeted latency fixes.

• Reduce blocking, contention, and unbounded queues.
• Reduce allocations/serialization overhead in hot paths.
• Use batching, caching, and async boundaries only when measured beneficial.