About Anaconda Help Download Anaconda
Sign In
Anaconda.com

main / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py310hb4c1b22_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py311h3d4f45a_1.tar.bz2  2 years and 1 month ago 5 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py39h49fca51_1.tar.bz2  2 years and 1 month ago 42 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py38h49fca51_1.tar.bz2  2 years and 1 month ago 36 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py310h49fca51_1.tar.bz2  2 years and 1 month ago 38 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py311h49fca51_1.tar.bz2  2 years and 1 month ago 33 main
conda 3.3 MB | osx-arm64/tokenizers-0.13.2-py39h3dd52b7_1.tar.bz2  2 years and 1 month ago 11 main
conda 3.3 MB | osx-arm64/tokenizers-0.13.2-py310h3dd52b7_1.tar.bz2  2 years and 1 month ago 12 main
conda 3.3 MB | osx-arm64/tokenizers-0.13.2-py38h3dd52b7_1.tar.bz2  2 years and 1 month ago 7 main
conda 3.3 MB | osx-arm64/tokenizers-0.13.2-py311h3dd52b7_1.tar.bz2  2 years and 1 month ago 46 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py39h5240035_1.tar.bz2  2 years and 1 month ago 14 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py38h5240035_1.tar.bz2  2 years and 1 month ago 11 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py311h5240035_1.tar.bz2  2 years and 1 month ago 11 main
conda 3.3 MB | osx-64/tokenizers-0.13.2-py310h5240035_1.tar.bz2  2 years and 1 month ago 8 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py39h7a5b571_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py39h3d4f45a_1.tar.bz2  2 years and 1 month ago 6 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py38h7a5b571_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py311h7a5b571_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py38h3d4f45a_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py310h7a5b571_1.tar.bz2  2 years and 1 month ago 15 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.13.2-py310h3d4f45a_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py39hb4c1b22_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py39h16a14c6_1.tar.bz2  2 years and 1 month ago 13 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py38hb4c1b22_1.tar.bz2  2 years and 1 month ago 5 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py38h16a14c6_1.tar.bz2  2 years and 1 month ago 5 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.0) Legal | Privacy Policy