bitsandbytes
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
3 items
| Name | Latest Version |
|---|
main | 0.44.0 |
rocketce-1.11.5 | 0.44.0 |
rocketce-1.11.6 | 0.44.0 |