torchao
PyTorch native quantization and sparsity for training and inference
PyTorch native quantization and sparsity for training and inference
To install this package, run one of the following:
TorchAO is a PyTorch-native model optimization framework leveraging quantization and sparsity to provide an end-to-end, training-to-serving workflow for AI models. TorchAO works out-of-the-box with torch.compile() and FSDP2 across most HuggingFace PyTorch models.
Summary
PyTorch native quantization and sparsity for training and inference
Last Updated
Oct 20, 2025 at 19:52
License
BSD-3-Clause
Supported Platforms
GitHub Repository
https://github.com/pytorch/aoDocumentation
https://docs.pytorch.org/ao/stable/