About Anaconda Help Download Anaconda

A high-throughput and memory-efficient inference and serving engine for LLMs

copied from cf-post-staging / vllm

Installers

  • linux-64 v0.8.3
  • osx-arm64 v0.8.3

conda install

To install this package run one of the following:
conda install conda-forge::vllm

Description

Easy, fast, and cheap LLM serving for everyone


© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.0) Legal | Privacy Policy