About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud

HuggingFace / packages / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 3.0 MB | win-64/tokenizers-0.11.4-py37_0.tar.bz2  3 years and 2 months ago 18 main
conda 3.0 MB | win-64/tokenizers-0.11.4-py39_0.tar.bz2  3 years and 2 months ago 32 main
conda 3.2 MB | osx-64/tokenizers-0.11.4-py39_0.tar.bz2  3 years and 2 months ago 15 main
conda 3.2 MB | osx-64/tokenizers-0.11.4-py38_0.tar.bz2  3 years and 2 months ago 15 main
conda 3.2 MB | osx-64/tokenizers-0.11.4-py37_0.tar.bz2  3 years and 2 months ago 12 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py37_0.tar.bz2  3 years and 2 months ago 61 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py38_0.tar.bz2  3 years and 2 months ago 53 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py39_0.tar.bz2  3 years and 2 months ago 75 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 10 months ago 1680 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 10 months ago 1998 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 10 months ago 3241 main
conda 1.9 MB | win-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 10 months ago 3447 main
conda 1.9 MB | win-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 10 months ago 2831 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 10 months ago 9369 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 10 months ago 7698 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 10 months ago 18396 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 10 months ago 4122 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 10 months ago 9 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 10 months ago 16 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 10 months ago 21 main
conda 1.8 MB | win-64/tokenizers-0.10.2-py37_0.tar.bz2  4 years and 16 days ago 364 main
conda 1.9 MB | win-64/tokenizers-0.10.2-py36_0.tar.bz2  4 years and 16 days ago 194 main
conda 1.8 MB | win-64/tokenizers-0.10.2-py38_0.tar.bz2  4 years and 16 days ago 769 main
conda 2.0 MB | osx-64/tokenizers-0.10.2-py35_0.tar.bz2  4 years and 16 days ago 8 main
conda 1.8 MB | win-64/tokenizers-0.10.2-py35_0.tar.bz2  4 years and 16 days ago 15 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.1.0) Legal | Privacy Policy