Ray

Ray is the compute layer for AI. It powers ChatGPT training and massive scale workloads. v3.0 (2025) improves efficiency and adds an MCP Server for agents.

When to Use

• Distributed Training: Scaling PyTorch across 100 GPUs.
• Ray Serve: Serving LLMs with high throughput (vLLM integration).
• Hyperparameter Tuning: Ray Tune is the industry standard.

Core Concepts

Actors & Tasks

• Task: Stateless function (like Lambda).
• Actor: Stateful class (like a microservice).

Object Store