About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud

HuggingFace / packages / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 1.8 MB | win-64/tokenizers-0.9.4-py36_0.tar.bz2  4 years and 4 months ago 815 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py38_0.tar.bz2  4 years and 4 months ago 903 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py37_0.tar.bz2  4 years and 4 months ago 1178 main
conda 1.9 MB | osx-64/tokenizers-0.9.4-py38_0.tar.bz2  4 years and 4 months ago 398 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py35_0.tar.bz2  4 years and 4 months ago 12 main
conda 1.9 MB | osx-64/tokenizers-0.9.4-py36_0.tar.bz2  4 years and 4 months ago 198 main
conda 1.9 MB | osx-64/tokenizers-0.9.4-py37_0.tar.bz2  4 years and 4 months ago 558 main
conda 1.9 MB | osx-64/tokenizers-0.9.4-py35_0.tar.bz2  4 years and 4 months ago 7 main
conda 2.7 MB | linux-64/tokenizers-0.9.4-py35_0.tar.bz2  4 years and 4 months ago 19 main
conda 2.7 MB | linux-64/tokenizers-0.9.4-py36_0.tar.bz2  4 years and 4 months ago 2033 main
conda 2.7 MB | linux-64/tokenizers-0.9.4-py37_0.tar.bz2  4 years and 4 months ago 149231 main
conda 2.7 MB | linux-64/tokenizers-0.9.4-py38_0.tar.bz2  4 years and 4 months ago 2801 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy