vLLM

Purpose

• Use this skill to deploy local or remote LLM inference with vllm.
• Prefer it when you need OpenAI-compatible serving, high throughput, and modern GPU utilization.
• vLLM is strongest for decoder-only chat and completion models.
• It is a good default for production inference when latency and token throughput matter.

Install

• Install from PyPI:

pip install vllm

• Verify the install: