CoreWeave Core Workflow: KServe Inference

Community-contributed. Not affiliated with, endorsed by, or sponsored by CoreWeave, Inc. CoreWeave is a registered trademark of CoreWeave, Inc.

Overview

Deploy production inference services on CoreWeave using KServe InferenceService with GPU scheduling, autoscaling, and scale-to-zero. CKS natively integrates with KServe for serverless GPU inference.

Prerequisites

• Completed coreweave-install-auth setup
• KServe available on your CKS cluster
• Model stored in S3, GCS, or HuggingFace

Instructions

Step 1: Deploy an InferenceService