AutoAWQ is an easy-to-use package for 4-bit quantized models.
conda install conda-forge::autoawq_kernels