vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Installation
To install this package, run one of the following:
Installation commands are not available for this package.
Usage Tracking
0 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
A high-throughput and memory-efficient inference and serving engine for LLMs
Last Updated
Sep 29, 2025 at 20:44
License
Apache-2.0 AND BSD-3-Clause
Total Downloads
0
Documentation
https://vllm.readthedocs.io/en/latest/