CMD + K

torchao

Anaconda Verified

PyTorch-native quantization and optimization library for training and inference

Installation

To install this package, run one of the following:

Conda
$conda install anaconda::torchao

Try This Package Beta

Usage Tracking

0.18.0
0.17.0
0.16.0
3 / 8 versions selected
Downloads (Last 6 months): 0

Description

TorchAO is an easy-to-use quantization and optimization library built on native PyTorch. It provides quantization (INT8, INT4, FP8), sparsity, and low-bit optimizer support, and works out-of-the-box with torch.compile() and FSDP2. TorchAO is the official PyTorch quantization backend for vLLM, HuggingFace Transformers, and TorchTune.

About

Summary

PyTorch-native quantization and optimization library for training and inference

Last Updated

Aug 13, 2026 at 18:31

License

BSD-3-Clause

Supported Platforms

linux-64
linux-aarch64
macOS-arm64
win-64