About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.8 MB | linux-64/tokenizers-0.22.2-py314h27d2130_1.tar.bz2  19 days and 28 minutes ago 1 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py313hac4c11a_1.tar.bz2  19 days and 28 minutes ago 3 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py311hac4c11a_1.tar.bz2  19 days and 28 minutes ago 2 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py312hac4c11a_1.tar.bz2  19 days and 28 minutes ago 1 main
conda 2.8 MB | linux-64/tokenizers-0.22.2-py310hac4c11a_1.tar.bz2  19 days and 28 minutes ago 3 main
conda 2.8 MB | linux-aarch64/tokenizers-0.22.2-py314he4be11e_1.tar.bz2  19 days and 9 hours ago 3 main
conda 2.8 MB | linux-aarch64/tokenizers-0.22.2-py313he80eeee_1.tar.bz2  19 days and 9 hours ago 3 main
conda 2.8 MB | linux-aarch64/tokenizers-0.22.2-py312he80eeee_1.tar.bz2  19 days and 9 hours ago 3 main
conda 2.8 MB | linux-aarch64/tokenizers-0.22.2-py311he80eeee_1.tar.bz2  19 days and 9 hours ago 3 main
conda 2.8 MB | linux-aarch64/tokenizers-0.22.2-py310he80eeee_1.tar.bz2  19 days and 9 hours ago 3 main
conda 2.4 MB | win-64/tokenizers-0.22.2-py314hfcf8c06_1.tar.bz2  19 days and 10 hours ago 3 main
conda 2.4 MB | win-64/tokenizers-0.22.2-py313h9f3fdb6_1.tar.bz2  19 days and 10 hours ago 5 main
conda 2.4 MB | win-64/tokenizers-0.22.2-py312h9f3fdb6_1.tar.bz2  19 days and 10 hours ago 3 main
conda 2.4 MB | win-64/tokenizers-0.22.2-py311h9f3fdb6_1.tar.bz2  19 days and 10 hours ago 33 main
conda 2.4 MB | win-64/tokenizers-0.22.2-py310h9f3fdb6_1.tar.bz2  19 days and 10 hours ago 5 main
conda 2.5 MB | osx-arm64/tokenizers-0.22.2-py314hb450910_1.tar.bz2  19 days and 10 hours ago 2 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.2-py313h5dd1ca5_1.tar.bz2  19 days and 10 hours ago 2 main
conda 2.5 MB | osx-arm64/tokenizers-0.22.2-py312h5dd1ca5_1.tar.bz2  19 days and 10 hours ago 2 main
conda 2.6 MB | osx-arm64/tokenizers-0.22.2-py311h5dd1ca5_1.tar.bz2  19 days and 10 hours ago 4 main
conda 2.5 MB | osx-arm64/tokenizers-0.22.2-py310h5dd1ca5_1.tar.bz2  19 days and 10 hours ago 2 main
conda 2.6 MB | linux-64/tokenizers-0.21.4-py314h79e15fb_0.tar.bz2  24 days and 15 hours ago 0 main
conda 2.6 MB | linux-64/tokenizers-0.21.4-py313h25936b3_0.tar.bz2  24 days and 15 hours ago 0 main
conda 2.6 MB | linux-64/tokenizers-0.21.4-py312h25936b3_0.tar.bz2  24 days and 15 hours ago 2 main
conda 2.6 MB | linux-64/tokenizers-0.21.4-py311h25936b3_0.tar.bz2  24 days and 15 hours ago 0 main
conda 2.6 MB | linux-64/tokenizers-0.21.4-py310h25936b3_0.tar.bz2  24 days and 15 hours ago 10 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.15) Legal | Privacy Policy