xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards ompatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingface_hub. <br/> hf_xet: Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.
To install this package, run one of the following:
Summary
xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards ompatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingface_hub. <br/> hf_xet: Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.
Last Updated
Nov 22, 2025 at 01:02
License
Apache-2.0
Total Downloads
1.1M
Version Downloads
341.3K
Supported Platforms
GitHub Repository
https://github.com/huggingface/xet-core