bitsandbytes
k-bit optimizers and matrix multiplication routines.
k-bit optimizers and matrix multiplication routines.
To install this package, run one of the following:
A lightweight wrapper around CUDA custom functions for 8-bit opimtizers, matrix multiplication, and both 4- and 8- bit quantization functions.
Summary
k-bit optimizers and matrix multiplication routines.
Last Updated
Sep 19, 2025 at 00:54
License
MIT
Supported Platforms
Documentation
https://huggingface.co/docs/bitsandbytes/main/en/index