About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py311h16a14c6_1.tar.bz2  2 years and 6 months ago 17 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py310hb4c1b22_1.tar.bz2  2 years and 6 months ago 16 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.2-py310h16a14c6_1.tar.bz2  2 years and 6 months ago 16 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py39he7d60b5_1.tar.bz2  2 years and 6 months ago 319 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py39h22610ee_1.tar.bz2  2 years and 6 months ago 100 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py38he7d60b5_1.tar.bz2  2 years and 6 months ago 218 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py38h22610ee_1.tar.bz2  2 years and 6 months ago 95 main
conda 4.5 MB | linux-64/tokenizers-0.13.2-py311he7d60b5_1.tar.bz2  2 years and 6 months ago 450 main
conda 4.5 MB | linux-64/tokenizers-0.13.2-py311h22610ee_1.tar.bz2  2 years and 6 months ago 336 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py310he7d60b5_1.tar.bz2  2 years and 6 months ago 377 main
conda 4.4 MB | linux-64/tokenizers-0.13.2-py310h22610ee_1.tar.bz2  2 years and 6 months ago 158 main
conda 3.0 MB | win-64/tokenizers-0.13.2-py311h49fca51_0.tar.bz2  2 years and 9 months ago 28 main
conda 3.2 MB | osx-arm64/tokenizers-0.13.2-py311h3dd52b7_0.tar.bz2  2 years and 9 months ago 41 main
conda 3.2 MB | osx-64/tokenizers-0.13.2-py311h5240035_0.tar.bz2  2 years and 9 months ago 19 main
conda 4.4 MB | linux-s390x/tokenizers-0.13.2-py311he89db31_0.tar.bz2  2 years and 9 months ago 17 main
conda 4.8 MB | linux-ppc64le/tokenizers-0.13.2-py311h7a5b571_0.tar.bz2  2 years and 9 months ago 11 main
conda 4.4 MB | linux-aarch64/tokenizers-0.13.2-py311h16a14c6_0.tar.bz2  2 years and 9 months ago 17 main
conda 4.3 MB | linux-64/tokenizers-0.13.2-py311he7d60b5_0.tar.bz2  2 years and 9 months ago 50 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy