torchao
PyTorch-native quantization and optimization library for training and inference
PyTorch-native quantization and optimization library for training and inference
To install this package, run one of the following:
TorchAO is an easy-to-use quantization and optimization library built on native PyTorch. It provides quantization (INT8, INT4, FP8), sparsity, and low-bit optimizer support, and works out-of-the-box with torch.compile() and FSDP2. TorchAO is the official PyTorch quantization backend for vLLM, HuggingFace Transformers, and TorchTune.
Summary
PyTorch-native quantization and optimization library for training and inference
Last Updated
Aug 13, 2026 at 18:31
License
BSD-3-Clause
Supported Platforms
GitHub Repository
https://github.com/pytorch/aoDocumentation
https://docs.pytorch.org/ao/stable/index.html