auto_gptq

Community

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Versions

To install this package, run one of the following:

$conda install conda-forge::auto_gptq

Version

2 / 8 versions selected

Downloads (Last 6 months): 0

Summary

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Last Updated

Jun 19, 2024 at 16:02

License

MIT

Total Downloads

93.9K

Supported Platforms

linux-64

Home