About Anaconda Help Download Anaconda
Sign In
Anaconda.com

main / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.2 MB | osx-64/tokenizers-0.19.1-py311hb453228_0.tar.bz2  1 year and 6 months ago 9 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py310h1c4dec2_0.tar.bz2  1 year and 6 months ago 10 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py38hf649420_0.tar.bz2  1 year and 6 months ago 4 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py39hf649420_0.tar.bz2  1 year and 6 months ago 3 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py312h88147cb_0.tar.bz2  1 year and 6 months ago 3 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py311h2eb9000_0.tar.bz2  1 year and 6 months ago 3 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py310hf649420_0.tar.bz2  1 year and 6 months ago 3 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py39h4936d6f_0.tar.bz2  1 year and 6 months ago 5 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py38h4936d6f_0.tar.bz2  1 year and 6 months ago 5 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py310h4936d6f_0.tar.bz2  1 year and 6 months ago 5 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py312ha5d0b93_0.tar.bz2  1 year and 6 months ago 5 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py311h93e1ca7_0.tar.bz2  1 year and 6 months ago 5 main
conda 3.1 MB | linux-64/tokenizers-0.19.1-py39hff361bb_0.tar.bz2  1 year and 6 months ago 29 main
conda 3.1 MB | linux-64/tokenizers-0.19.1-py38hff361bb_0.tar.bz2  1 year and 6 months ago 27 main
conda 3.1 MB | linux-64/tokenizers-0.19.1-py312ha11519a_0.tar.bz2  1 year and 6 months ago 28 main
conda 3.1 MB | linux-64/tokenizers-0.19.1-py311h585d796_0.tar.bz2  1 year and 6 months ago 33 main
conda 3.1 MB | linux-64/tokenizers-0.19.1-py310hff361bb_0.tar.bz2  1 year and 6 months ago 27 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py312h49fca51_0.tar.bz2  1 year and 11 months ago 16 main
conda 2.2 MB | osx-arm64/tokenizers-0.15.1-py312h3dd52b7_0.tar.bz2  1 year and 11 months ago 5 main
conda 2.1 MB | osx-64/tokenizers-0.15.1-py312h5240035_0.tar.bz2  1 year and 11 months ago 9 main
conda 3.1 MB | linux-s390x/tokenizers-0.15.1-py312ha9e02f1_0.tar.bz2  1 year and 11 months ago 3 main
conda 3.0 MB | linux-aarch64/tokenizers-0.15.1-py312hb4c1b22_0.tar.bz2  1 year and 11 months ago 12 main
conda 3.0 MB | linux-64/tokenizers-0.15.1-py312h22610ee_0.tar.bz2  1 year and 11 months ago 39 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py39h49fca51_0.tar.bz2  2 years and 1 month ago 31 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py38h49fca51_0.tar.bz2  2 years and 1 month ago 24 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.15) Legal | Privacy Policy