xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards ompatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingface_hub. <br/> hf_xet: Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.
To install this package, run one of the following:
Summary
xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards ompatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingface_hub. <br/> hf_xet: Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.
Last Updated
May 6, 2026 at 08:01
License
Apache-2.0
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/huggingface/xet-core