Incident triage

If you change the order below, say why in #sre.

Order of operations

1. Pull deploys for the last 6h. Don't open the log first.
2. Line the deploy timestamps up against p99_latency_ms / error_rate for the paged service. State the gap ("deploy 14:31, p99 moves 14:33").
3. If a deploy lines up: pull the diff, read it. Check for the stuff in the next section.
4. Then grep the log to confirm. Don't grep to fish.
5. No deploy lines up → the service may be a victim. Check db_pool_utilization across checkout/cart/auth/inventory, then the upstream deps (db-primary, db-inventory, idp.internal). Find what moved first.

Ask get_metrics for a name that doesn't exist and it lists the ones that do.

Things that have burned us

In rough order of how often: