About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.0 MB | win-64/tokenizers-0.19.1-py312hc899e84_0.tar.bz2  1 year and 30 days ago 84 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py39h7ac788d_0.tar.bz2  1 year and 30 days ago 54 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py38h7ac788d_0.tar.bz2  1 year and 30 days ago 53 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py311h2da67c9_0.tar.bz2  1 year and 30 days ago 139 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py310h7ac788d_0.tar.bz2  1 year and 30 days ago 234 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py39h92154f2_0.tar.bz2  1 year and 30 days ago 26 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py38h92154f2_0.tar.bz2  1 year and 30 days ago 18 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py312ha1e0277_0.tar.bz2  1 year and 30 days ago 39 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py311he19d34d_0.tar.bz2  1 year and 30 days ago 44 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py310h92154f2_0.tar.bz2  1 year and 30 days ago 31 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py39h1c4dec2_0.tar.bz2  1 year and 30 days ago 18 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py38h1c4dec2_0.tar.bz2  1 year and 30 days ago 15 main
conda 2.2 MB | osx-64/tokenizers-0.19.1-py312hfa73619_0.tar.bz2  1 year and 30 days ago 18 main
conda 2.2 MB | osx-64/tokenizers-0.19.1-py311hb453228_0.tar.bz2  1 year and 30 days ago 16 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py310h1c4dec2_0.tar.bz2  1 year and 30 days ago 21 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py39hf649420_0.tar.bz2  1 year and 30 days ago 11 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py38hf649420_0.tar.bz2  1 year and 30 days ago 10 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py312h88147cb_0.tar.bz2  1 year and 30 days ago 10 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py311h2eb9000_0.tar.bz2  1 year and 30 days ago 11 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py310hf649420_0.tar.bz2  1 year and 30 days ago 10 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py39h4936d6f_0.tar.bz2  1 year and 30 days ago 14 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py38h4936d6f_0.tar.bz2  1 year and 30 days ago 10 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py312ha5d0b93_0.tar.bz2  1 year and 30 days ago 11 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py311h93e1ca7_0.tar.bz2  1 year and 30 days ago 15 main
conda 3.0 MB | linux-aarch64/tokenizers-0.19.1-py310h4936d6f_0.tar.bz2  1 year and 30 days ago 13 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.0) Legal | Privacy Policy