About Anaconda Help Download Anaconda
Sign In
Anaconda.com

main / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.5 MB | win-64/tokenizers-0.22.1-py313h4510a99_0.tar.bz2  6 days and 10 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py312h4510a99_0.tar.bz2  6 days and 10 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py311h4510a99_0.tar.bz2  6 days and 10 hours ago 4 main
conda 2.5 MB | win-64/tokenizers-0.22.1-py310h4510a99_0.tar.bz2  6 days and 10 hours ago 4 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py313h99e1e97_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py312h99e1e97_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py310h99e1e97_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.1-py311h99e1e97_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py313hb555b49_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py312hb555b49_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py311hb555b49_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.9 MB | linux-aarch64/tokenizers-0.22.1-py310hb555b49_0.tar.bz2  6 days and 10 hours ago 0 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py313h4b931ed_0.tar.bz2  6 days and 10 hours ago 6 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py311h4b931ed_0.tar.bz2  6 days and 10 hours ago 6 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py310h4b931ed_0.tar.bz2  6 days and 10 hours ago 7 main
conda 2.9 MB | linux-64/tokenizers-0.22.1-py312h4b931ed_0.tar.bz2  6 days and 10 hours ago 6 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.6) Legal | Privacy Policy