About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.5 MB | linux-64/tokenizers-0.21.0-py39ha92566c_0.tar.bz2  1 month and 15 days ago 43 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py310ha92566c_0.tar.bz2  1 month and 15 days ago 110 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py312h526025d_0.tar.bz2  1 month and 15 days ago 121 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py311h5e3497e_0.tar.bz2  1 month and 15 days ago 104 main
conda 2.5 MB | linux-64/tokenizers-0.21.0-py313hb8e4a85_0.tar.bz2  1 month and 15 days ago 44 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.1.0) Legal | Privacy Policy