vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
A high-throughput and memory-efficient inference and serving engine for LLMs
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-64/vllm-0.10.2-cuda_129py312he88dff9_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 257.37 MB | 81 | |
linux-64/vllm-0.10.2-cuda_129py313hea55ce0_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 257.49 MB | 116 | |
linux-64/vllm-0.10.2-cuda_129py311h8746ef1_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 257.2 MB | 86 | |
linux-aarch64/vllm-0.10.2-cpu_py313h52210ee_0.conda | conda | 0.10.2 | linux-aarch64 | main | 21 days ago | 10.35 MB | 32 | |
linux-64/vllm-0.10.2-cpu_py311h82aa598_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 7.22 MB | 113 | |
linux-64/vllm-0.10.2-cpu_py312h4a4133c_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 7.07 MB | 126 | |
linux-aarch64/vllm-0.10.2-cpu_py311h979ccba_0.conda | conda | 0.10.2 | linux-aarch64 | main | 21 days ago | 10.42 MB | 27 | |
linux-aarch64/vllm-0.10.2-cpu_py312h7eba881_0.conda | conda | 0.10.2 | linux-aarch64 | main | 21 days ago | 10.26 MB | 30 | |
linux-aarch64/vllm-0.10.2-cpu_py310he7c1c3b_0.conda | conda | 0.10.2 | linux-aarch64 | main | 21 days ago | 8.84 MB | 30 | |
linux-64/vllm-0.10.2-cpu_py313hb6c8006_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 7.15 MB | 100 | |
linux-64/vllm-0.10.2-cpu_py310h4b8f3e3_0.conda | conda | 0.10.2 | linux-64 | main | 21 days ago | 5.67 MB | 119 | |
osx-arm64/vllm-0.10.2-cpu_py310h56a5926_0.conda | conda | 0.10.2 | osx-arm64 | main | 21 days ago | 5.61 MB | 33 | |
osx-arm64/vllm-0.10.2-cpu_py312h345645a_0.conda | conda | 0.10.2 | osx-arm64 | main | 21 days ago | 7.02 MB | 31 | |
osx-arm64/vllm-0.10.2-cpu_py311h3e6c629_0.conda | conda | 0.10.2 | osx-arm64 | main | 21 days ago | 7.17 MB | 36 | |
osx-arm64/vllm-0.10.2-cpu_py313h9fb6c3a_0.conda | conda | 0.10.2 | osx-arm64 | main | 21 days ago | 7.11 MB | 34 | |
linux-64/vllm-0.10.1-cpu_py311h82aa598_0.conda | conda | 0.10.1 | linux-64 | main | 21 days ago | 6.75 MB | 91 | |
linux-64/vllm-0.10.1-cpu_py310h4b8f3e3_0.conda | conda | 0.10.1 | linux-64 | main | 21 days ago | 5.28 MB | 97 | |
linux-64/vllm-0.10.1-cuda_129py311h8746ef1_0.conda | conda | 0.10.1 | linux-64 | main | 22 days ago | 249.76 MB | 79 | |
linux-64/vllm-0.10.1-cuda_129py310h15d025c_0.conda | conda | 0.10.1 | linux-64 | main | 22 days ago | 248.23 MB | 87 | |
linux-64/vllm-0.10.1-cuda_129py312he88dff9_0.conda | conda | 0.10.1 | linux-64 | main | 22 days ago | 250.11 MB | 87 | |
linux-aarch64/vllm-0.10.1-cpu_py312h7eba881_0.conda | conda | 0.10.1 | linux-aarch64 | main | 22 days ago | 9.8 MB | 28 | |
linux-aarch64/vllm-0.10.1-cpu_py310he7c1c3b_0.conda | conda | 0.10.1 | linux-aarch64 | main | 22 days ago | 8.47 MB | 36 | |
linux-aarch64/vllm-0.10.1-cpu_py311h979ccba_0.conda | conda | 0.10.1 | linux-aarch64 | main | 22 days ago | 9.95 MB | 32 | |
linux-64/vllm-0.10.1-cpu_py312h4a4133c_0.conda | conda | 0.10.1 | linux-64 | main | 22 days ago | 6.61 MB | 93 | |
osx-arm64/vllm-0.10.1-cpu_py312h345645a_0.conda | conda | 0.10.1 | osx-arm64 | main | 22 days ago | 9.46 MB | 30 |