Governed Vast.ai GPU Workload Architecture

Overview

Center the architecture on an immutable run or release manifest and a lifecycle ledger. Search and planning are read-only; paid resource creation crosses an approval boundary; execution writes recoverable state externally; teardown closes both cost and evidence.

Prerequisites

• Batch, training, interactive, or Serverless workload inventory with SLOs
• Data, model, image, credential, region, reliability, and spend policies
• Owners for approval, execution, recovery, billing, security, and platform incidents

Instructions

Step 1: Define the immutable intent

Create a signed or versioned manifest containing workload bytes, image/template/model identity, GPU policy, data/checkpoint routes, SLOs, budget, and expiry.

Step 2: Separate planner and mutator