Easy, fast, and cost-efficient LLM serving for everyone.
Easy
Deploy the widest range of open-source models on any hardware. Includes a drop-in OpenAI-compatible API for instant integration.
Fast
Maximize throughput with PagedAttention. Advanced scheduling and continuous batching ensure peak GPU utilization.
Cost Efficient
Slash inference costs by maximizing hardware efficiency. We make high-performance LLMs affordable and accessible to everyone.
What's new
Latest from vLLM
Releases, day-0 model support and the latest from the vLLM blog.
- BlogZero Mismatch, Simple Async RL: REINFORCE Zero, DeepSeek-V4.1 and Kimi K3.1
Asynchronous RL trains on stale weights. Align rollout and training kernels bit for bit, and unclipped importance sampling corrects that lag. Plus zero-mismatch RL for DeepSeek-V4.1-Flash, Kimi K3.1 and AMD MI355X.
- BlogIntroducing Kinference: An Open Source Inference Control Plane for vLLM and Kubernetes
Kinference is a new open source inference control plane for building scalable inference platforms with vLLM and Kubernetes, providing token rate limiting, tenant usage and cost tracking, intelligent load balancing, and inference policies.
- ReleasevLLM v0.33.0 is out: New models
927 commits from 389 contributors · PyTorch 2.14 · CUDA 12.9 dropped
Quick Start
Select your preferences and run the install command. Stable represents the most currently tested and supported version of vLLM. Nightly is available if you want the latest builds.
📦 Requires Python 3.10+. Python 3.12+ recommended.
⚡ We recommend uv for faster and more reliable installation.
🔧 For other platforms, see docs.vllm.ai
🎉 See what's new in
💡 Compatible with all CUDA 13.x versions (13.0 - 13.1) · Troubleshooting
Sponsors
vLLM is a community project. Our compute resources for development and testing are supported by the following organizations. Thank you for your support!
Cash Donations
Compute Resources
Slack Sponsor
We collect donation through GitHub and OpenCollective. We plan to use the fund to support the development, maintenance, and adoption of vLLM.
Universal Compatibility
One engine, endless possibilities. Run any model on any hardware.
Hardware
Unified API across platforms
Open Models
Latest trending open-source models, optimized & production-ready
Got questions?
We're here to help.
Whether you're just getting started or debugging a complex deployment, our community is open to everyone. No question is too basic!
Resources
Explore recipes, benchmarks, and roadmap