About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.4 MB | win-64/tokenizers-0.23.1-py314hfcf8c06_0.tar.bz2  19 days and 18 hours ago 5 main
conda 2.4 MB | win-64/tokenizers-0.23.1-py313h9f3fdb6_0.tar.bz2  19 days and 18 hours ago 5 main
conda 2.5 MB | win-64/tokenizers-0.23.1-py312h9f3fdb6_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.5 MB | win-64/tokenizers-0.23.1-py311h9f3fdb6_0.tar.bz2  19 days and 18 hours ago 39 main
conda 2.5 MB | win-64/tokenizers-0.23.1-py310h9f3fdb6_0.tar.bz2  19 days and 18 hours ago 5 main
conda 2.6 MB | osx-arm64/tokenizers-0.23.1-py313h5dd1ca5_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.23.1-py314hb450910_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.23.1-py312h5dd1ca5_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.23.1-py311h5dd1ca5_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.6 MB | osx-arm64/tokenizers-0.23.1-py310h5dd1ca5_0.tar.bz2  19 days and 18 hours ago 6 main
conda 2.9 MB | linux-aarch64/tokenizers-0.23.1-py314he4be11e_0.tar.bz2  19 days and 19 hours ago 6 main
conda 2.8 MB | linux-aarch64/tokenizers-0.23.1-py313he80eeee_0.tar.bz2  19 days and 19 hours ago 6 main
conda 2.8 MB | linux-aarch64/tokenizers-0.23.1-py312he80eeee_0.tar.bz2  19 days and 19 hours ago 5 main
conda 2.8 MB | linux-aarch64/tokenizers-0.23.1-py311he80eeee_0.tar.bz2  19 days and 19 hours ago 5 main
conda 2.8 MB | linux-aarch64/tokenizers-0.23.1-py310he80eeee_0.tar.bz2  19 days and 19 hours ago 5 main
conda 2.9 MB | linux-64/tokenizers-0.23.1-py314h27d2130_0.tar.bz2  19 days and 23 hours ago 7 main
conda 2.9 MB | linux-64/tokenizers-0.23.1-py313hac4c11a_0.tar.bz2  19 days and 23 hours ago 6 main
conda 2.9 MB | linux-64/tokenizers-0.23.1-py312hac4c11a_0.tar.bz2  19 days and 23 hours ago 8 main
conda 2.9 MB | linux-64/tokenizers-0.23.1-py311hac4c11a_0.tar.bz2  19 days and 23 hours ago 6 main
conda 2.9 MB | linux-64/tokenizers-0.23.1-py310hac4c11a_0.tar.bz2  19 days and 23 hours ago 6 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py314h27d2130_1.tar.bz2  2 months and 23 days ago 7 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py313hac4c11a_1.tar.bz2  2 months and 23 days ago 11 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py311hac4c11a_1.tar.bz2  2 months and 23 days ago 19 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py312hac4c11a_1.tar.bz2  2 months and 23 days ago 1763 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py310hac4c11a_1.tar.bz2  2 months and 23 days ago 12 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.18) Legal | Privacy Policy