vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Installation
To install this package, run one of the following:
Usage Tracking
0.19.1
0.10.2
0.10.1
0.10.0
0.9.2
5 / 8 versions selected
Downloads (Last 6 months): 0
Description
Easy, fast, and cheap LLM serving for everyone
About
Summary
A high-throughput and memory-efficient inference and serving engine for LLMs
Last Updated
Apr 27, 2026 at 14:19
License
Apache-2.0 AND BSD-3-Clause
Supported Platforms
linux-aarch64
linux-64
macOS-arm64
Documentation
https://vllm.readthedocs.io/en/latest/