Modal Serverless GPU

Guide to running ML workloads on Modal's serverless GPU cloud platform.

When to use Modal

Use Modal when:

• Running GPU-intensive ML workloads without managing infrastructure
• Deploying ML models as auto-scaling APIs
• Running batch processing jobs (training, inference, data processing)
• Need pay-per-second GPU pricing without idle costs
• Prototyping ML applications quickly
• Running scheduled jobs (cron-like workloads)