xet-core enables huggingface_hub to utilize xet storage for uploading and downloading to HF Hub.
xet-core enables huggingfacehub to utilize xet storage for uploading and downloading to HF Hub. Xet storage provides chunk-based deduplication, efficient storage/retrieval with local disk caching, and backwards compatibility with Git LFS. This library is not meant to be used directly, and is instead intended to be used from huggingfacehub. hf_xet - Python integration with Rust code, uses maturin to build hfxet Python package. Main integration with HF Hub Python package.
