About Anaconda Help Download Anaconda
Sign In
Anaconda.com

main / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.5 MB | win-64/tokenizers-0.22.1-py313h4510a99_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py312h4510a99_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py311h4510a99_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py310h4510a99_0.tar.bz2  6 days and 7 hours ago 4 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py313h99e1e97_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py312h99e1e97_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py310h99e1e97_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py311h99e1e97_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py313hb555b49_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py312hb555b49_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py311hb555b49_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py310hb555b49_0.tar.bz2  6 days and 7 hours ago 0 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py313h4b931ed_0.tar.bz2  6 days and 7 hours ago 5 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py311h4b931ed_0.tar.bz2  6 days and 7 hours ago 6 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py310h4b931ed_0.tar.bz2  6 days and 7 hours ago 7 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py312h4b931ed_0.tar.bz2  6 days and 7 hours ago 6 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py39h5bc5163_0.tar.bz2  8 months and 3 days ago 10 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py313hbd09cc8_0.tar.bz2  8 months and 3 days ago 10 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py312h482ea96_0.tar.bz2  8 months and 3 days ago 9 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py311hbb1481a_0.tar.bz2  8 months and 3 days ago 10 main
conda 2.3 MB | osx-arm64/tokenizers-0.21.0-py39hd743ec3_0.tar.bz2  8 months and 3 days ago 4 main
conda 2.2 MB | win-64/tokenizers-0.21.0-py310h5bc5163_0.tar.bz2  8 months and 3 days ago 12 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py313h5b23da0_0.tar.bz2  8 months and 3 days ago 12 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py312he2d9c3e_0.tar.bz2  8 months and 3 days ago 7 main
conda 2.4 MB | osx-arm64/tokenizers-0.21.0-py311hac6c8b7_0.tar.bz2  8 months and 3 days ago 7 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.6) Legal | Privacy Policy