bitsandbytes
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
- Overview
- Files 2
- Labels 3
- Badges
Installation
To install this package, run one of the following:
Usage Tracking
0.44.0
1 / 8 versions selected
Total downloads: 0
About
Summary
The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
Information Last Updated
Aug 20, 2025 at 15:50
License
MIT
Total Downloads
17
Platforms
Linux ppc64le Version: 0.44.0