vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Installation
To install this package, run one of the following:
Installation commands are not available for this package.
Usage Tracking
latest
1 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
A high-throughput and memory-efficient inference and serving engine for LLMs
Last Updated
Feb 4, 2026 at 18:13
License
Apache-2.0 AND BSD-3-Clause
Total Downloads
0
Version Downloads
0
Documentation
https://vllm.readthedocs.io/en/latest/