About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

Type Size Name Uploaded Downloads Labels
conda 2.2 MB | win-64/tokenizers-0.21.0-py313hbd09cc8_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py39h5bc5163_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py312h482ea96_0.tar.bz2  6 days and 7 hours ago 5 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py311hbb1481a_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py310h5bc5163_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.3 MB | osx-arm64/tokenizers-0.21.0-py39hd743ec3_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py313h5b23da0_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py312he2d9c3e_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py311hac6c8b7_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.3 MB | osx-arm64/tokenizers-0.21.0-py310hd743ec3_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py39h753fa65_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py313hf3198d1_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py312h74fea66_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py311h497a92b_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py310h753fa65_0.tar.bz2  6 days and 7 hours ago 3 main
conda 2.5 MB | linux-s390x/tokenizers-0.21.0-py39ha3609b1_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.5 MB | linux-s390x/tokenizers-0.21.0-py313hd4428f3_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.5 MB | linux-s390x/tokenizers-0.21.0-py312hc707890_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.5 MB | linux-s390x/tokenizers-0.21.0-py311he4aaa16_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.5 MB | linux-s390x/tokenizers-0.21.0-py310ha3609b1_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | linux-aarch64/tokenizers-0.21.0-py39hdc1999c_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | linux-aarch64/tokenizers-0.21.0-py313h3626e91_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | linux-aarch64/tokenizers-0.21.0-py312h377adab_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | linux-aarch64/tokenizers-0.21.0-py311hf2d19f8_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.4 MB | linux-aarch64/tokenizers-0.21.0-py310hdc1999c_0.tar.bz2  6 days and 7 hours ago 2 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py39ha92566c_0.tar.bz2  6 days and 7 hours ago 7 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py310ha92566c_0.tar.bz2  6 days and 7 hours ago 18 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py312h526025d_0.tar.bz2  6 days and 7 hours ago 9 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py311h5e3497e_0.tar.bz2  6 days and 7 hours ago 17 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py313hb8e4a85_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py39ha92566c_1.tar.bz2  3 months and 21 days ago 44 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py312h526025d_1.tar.bz2  3 months and 21 days ago 119 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py311h5e3497e_1.tar.bz2  3 months and 21 days ago 84 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py310ha92566c_1.tar.bz2  3 months and 21 days ago 395 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py39h5bc5163_1.tar.bz2  3 months and 21 days ago 37 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py312h482ea96_1.tar.bz2  3 months and 21 days ago 64 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py311hbb1481a_1.tar.bz2  3 months and 21 days ago 90 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py310h5bc5163_1.tar.bz2  3 months and 21 days ago 37 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py39hd743ec3_1.tar.bz2  3 months and 21 days ago 23 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py312he2d9c3e_1.tar.bz2  3 months and 21 days ago 28 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py311hac6c8b7_1.tar.bz2  3 months and 21 days ago 35 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py310hd743ec3_1.tar.bz2  3 months and 21 days ago 18 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py39h753fa65_1.tar.bz2  3 months and 21 days ago 7 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py312h74fea66_1.tar.bz2  3 months and 21 days ago 10 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py311h497a92b_1.tar.bz2  3 months and 21 days ago 13 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py310h753fa65_1.tar.bz2  3 months and 21 days ago 9 main
conda 2.5 MB | linux-s390x/tokenizers-0.20.1-py39ha3609b1_1.tar.bz2  3 months and 21 days ago 5 main
conda 2.5 MB | linux-s390x/tokenizers-0.20.1-py312hc707890_1.tar.bz2  3 months and 21 days ago 5 main
conda 2.5 MB | linux-s390x/tokenizers-0.20.1-py311he4aaa16_1.tar.bz2  3 months and 21 days ago 4 main
conda 2.5 MB | linux-s390x/tokenizers-0.20.1-py310ha3609b1_1.tar.bz2  3 months and 21 days ago 4 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy