bitsandbytes
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
Installation
To install this package, run one of the following:
Usage Tracking
0.49.1
0.49.0
0.48.2
0.48.1
0.48.0
5 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
Last Updated
Jan 8, 2026 at 19:41
License
MIT
Total Downloads
625.4K
Supported Platforms
linux-64