bitsandbytes
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
Installation
To install this package, run one of the following:
Usage Tracking
0.44.0
1 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
Last Updated
Mar 7, 2025 at 18:41
License
MIT
Total Downloads
17
Supported Platforms
linux-ppc64le