The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
copied from cf-post-staging / bitsandbytes| Label | Latest Version |
|---|---|
| main | 0.49.0 |
