About Anaconda Help Download Anaconda
Sign In
Anaconda.com
If you were automatically logged out you may need to refresh the page. You're trying to access a page that requires authentication. ×

HuggingFace / packages / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 3.0 MB | win-64/tokenizers-0.13.2-py38_0.tar.bz2  3 years and 4 months ago 233 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py310_0.tar.bz2  3 years and 4 months ago 978 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py37_0.tar.bz2  3 years and 4 months ago 119 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py310_0.tar.bz2  3 years and 4 months ago 202 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py37_0.tar.bz2  3 years and 4 months ago 21 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py39_0.tar.bz2  3 years and 4 months ago 427 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py39_0.tar.bz2  3 years and 4 months ago 145 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py38_0.tar.bz2  3 years and 4 months ago 65 main
conda 4.5 MB | linux-64/tokenizers-0.13.2-py38_0.tar.bz2  3 years and 4 months ago 527 main
conda 4.5 MB | linux-64/tokenizers-0.13.2-py37_0.tar.bz2  3 years and 4 months ago 188 main
conda 4.5 MB | linux-64/tokenizers-0.13.2-py39_0.tar.bz2  3 years and 4 months ago 812 main
conda 3.3 MB | osx-64/tokenizers-0.13.1-py38_0.tar.bz2  3 years and 6 months ago 84 main
conda 3.3 MB | osx-64/tokenizers-0.13.1-py37_0.tar.bz2  3 years and 6 months ago 20 main
conda 3.0 MB | win-64/tokenizers-0.13.1-py38_0.tar.bz2  3 years and 6 months ago 180 main
conda 3.0 MB | win-64/tokenizers-0.13.1-py39_0.tar.bz2  3 years and 6 months ago 930 main
conda 3.0 MB | win-64/tokenizers-0.13.1-py37_0.tar.bz2  3 years and 6 months ago 53 main
conda 3.3 MB | osx-64/tokenizers-0.13.1-py39_0.tar.bz2  3 years and 6 months ago 368 main
conda 4.5 MB | linux-64/tokenizers-0.13.1-py37_0.tar.bz2  3 years and 6 months ago 89 main
conda 4.5 MB | linux-64/tokenizers-0.13.1-py38_0.tar.bz2  3 years and 6 months ago 221 main
conda 4.5 MB | linux-64/tokenizers-0.13.1-py39_0.tar.bz2  3 years and 6 months ago 669 main
conda 3.0 MB | win-64/tokenizers-0.13.0-py37_0.tar.bz2  3 years and 6 months ago 25 main
conda 3.3 MB | osx-64/tokenizers-0.13.0-py39_0.tar.bz2  3 years and 6 months ago 17 main
conda 3.3 MB | osx-64/tokenizers-0.13.0-py38_0.tar.bz2  3 years and 6 months ago 17 main
conda 3.0 MB | win-64/tokenizers-0.13.0-py39_0.tar.bz2  3 years and 6 months ago 36 main
conda 3.0 MB | win-64/tokenizers-0.13.0-py38_0.tar.bz2  3 years and 6 months ago 34 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.17) Legal | Privacy Policy