The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
https://anaconda.org/rocketce-test/bitsandbytes/badges/version.svg
https://anaconda.org/rocketce-test/bitsandbytes/badges/latest_release_date.svg
https://anaconda.org/rocketce-test/bitsandbytes/badges/latest_release_relative_date.svg
https://anaconda.org/rocketce-test/bitsandbytes/badges/platforms.svg
https://anaconda.org/rocketce-test/bitsandbytes/badges/license.svg
https://anaconda.org/rocketce-test/bitsandbytes/badges/downloads.svg