Modal Servers

Use this skill when deploying a process that listens on a port inside Modal with the Server primitive (SDK 1.5.1+), optimized for ultra-low-latency HTTP between clients and containers.

For Function-based web endpoints (fastapi_endpoint / asgi_app / wsgi_app / web_server), see modal-web-serving. For one-command LLM inference products, see modal-endpoints.

When to Use This Skill

• Serving vLLM, SGLang, or any HTTP server with minimal proxy latency
• Need regional request routing (routing_region) close to clients
• Want sticky sessions via Modal-Session-ID
• Migrating from @modal.web_server to @app.server
• Need default authenticated ingress (proxy tokens) or explicit unauthenticated=True
• Building custom inference behind the same infrastructure as Auto Endpoints

Quick Start