About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py313h99e1e97_0.tar.bz2  1 month and 26 days ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py312h99e1e97_0.tar.bz2  1 month and 26 days ago 9 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py311h99e1e97_0.tar.bz2  1 month and 26 days ago 9 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py310h99e1e97_0.tar.bz2  1 month and 26 days ago 8 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py313hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py312hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py310hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py311hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py313h4b931ed_0.tar.bz2  1 month and 26 days ago 12 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py312h4b931ed_0.tar.bz2  1 month and 26 days ago 15 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py310h4b931ed_0.tar.bz2  1 month and 26 days ago 13 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py311h4b931ed_0.tar.bz2  1 month and 26 days ago 14 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py313hbd09cc8_0.tar.bz2  9 months and 23 days ago 52 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py39h5bc5163_0.tar.bz2  9 months and 23 days ago 52 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py312h482ea96_0.tar.bz2  9 months and 23 days ago 89 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py311hbb1481a_0.tar.bz2  9 months and 23 days ago 106 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py310h5bc5163_0.tar.bz2  9 months and 23 days ago 68 main
conda 2.3 MB | osx-arm64/tokenizers-0.21.0-py39hd743ec3_0.tar.bz2  9 months and 23 days ago 25 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py313h5b23da0_0.tar.bz2  9 months and 23 days ago 29 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py312he2d9c3e_0.tar.bz2  9 months and 23 days ago 41 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py311hac6c8b7_0.tar.bz2  9 months and 23 days ago 56 main
conda 2.3 MB | osx-arm64/tokenizers-0.21.0-py310hd743ec3_0.tar.bz2  9 months and 23 days ago 36 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py39h753fa65_0.tar.bz2  9 months and 23 days ago 17 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py313hf3198d1_0.tar.bz2  9 months and 23 days ago 21 main
conda 2.2 MB | osx-64/tokenizers-0.21.0-py312h74fea66_0.tar.bz2  9 months and 23 days ago 19 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy