CoreWeave Observability

Community-contributed. Not affiliated with, endorsed by, or sponsored by CoreWeave, Inc. CoreWeave is a registered trademark of CoreWeave, Inc.

Overview

CoreWeave runs GPU-intensive workloads on Kubernetes where hardware failures, memory exhaustion, and underutilization directly impact cost and reliability. Observability must cover DCGM GPU metrics, Kubernetes pod health, inference latency, and job completion rates. Proactive monitoring prevents wasted spend on idle GPUs and catches OOM conditions before they cascade.

Prerequisites

• A metrics backend receiving Kubernetes and DCGM exporter metrics.
• A named dashboard and on-call owner for the namespace or service.
• Log and trace redaction rules that exclude prompts, model outputs, tokens, and credentials.

Instructions