The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
copied from cf-staging / bitsandbytes
https://anaconda.org/conda-forge/bitsandbytes/badges/version.svg
https://anaconda.org/conda-forge/bitsandbytes/badges/latest_release_date.svg
https://anaconda.org/conda-forge/bitsandbytes/badges/latest_release_relative_date.svg
https://anaconda.org/conda-forge/bitsandbytes/badges/platforms.svg
https://anaconda.org/conda-forge/bitsandbytes/badges/license.svg
https://anaconda.org/conda-forge/bitsandbytes/badges/downloads.svg