bitsandbytes
k-bit optimizers and matrix multiplication routines.
k-bit optimizers and matrix multiplication routines.
To install this package, run one of the following:
A lightweight wrapper around CUDA custom functions for 8-bit opimtizers, matrix multiplication, and both 4- and 8- bit quantization functions.
Summary
k-bit optimizers and matrix multiplication routines.
Last Updated
Feb 12, 2026 at 06:05
License
MIT
Supported Platforms
Documentation
https://huggingface.co/docs/bitsandbytes/main/en/index