About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py314h402bb5a_0.tar.bz2  20 days and 3 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py313h4510a99_0.tar.bz2  1 month and 26 days ago 12 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py312h4510a99_0.tar.bz2  1 month and 26 days ago 12 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py311h4510a99_0.tar.bz2  1 month and 26 days ago 11 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py310h4510a99_0.tar.bz2  1 month and 26 days ago 10 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py313h99e1e97_0.tar.bz2  1 month and 26 days ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py312h99e1e97_0.tar.bz2  1 month and 26 days ago 9 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py311h99e1e97_0.tar.bz2  1 month and 26 days ago 9 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py310h99e1e97_0.tar.bz2  1 month and 26 days ago 8 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py313hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py312hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py310hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py311hb555b49_0.tar.bz2  1 month and 26 days ago 5 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py313h4b931ed_0.tar.bz2  1 month and 26 days ago 12 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py312h4b931ed_0.tar.bz2  1 month and 26 days ago 15 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py310h4b931ed_0.tar.bz2  1 month and 26 days ago 13 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py311h4b931ed_0.tar.bz2  1 month and 26 days ago 14 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy