About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py37h81d793f_1.tar.bz2  3 years and 8 months ago 25 main
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py310h81d793f_1.tar.bz2  3 years and 8 months ago 70 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py39h3dcd8bd_1.tar.bz2  3 years and 8 months ago 1121 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py38h3dcd8bd_1.tar.bz2  3 years and 8 months ago 1743 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py310h3dcd8bd_1.tar.bz2  3 years and 8 months ago 1643 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py37h3dcd8bd_1.tar.bz2  3 years and 8 months ago 462 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py39h5c5695e_0.tar.bz2  3 years and 8 months ago 31 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py310h5c5695e_0.tar.bz2  3 years and 8 months ago 27 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py38h5c5695e_0.tar.bz2  3 years and 8 months ago 26 main
conda 2.0 MB | osx-arm64/tokenizers-0.10.3-py39ha0c5f46_1.tar.bz2  3 years and 8 months ago 55 main
conda 2.0 MB | osx-arm64/tokenizers-0.10.3-py38ha0c5f46_1.tar.bz2  3 years and 8 months ago 31 main
conda 3.0 MB | linux-s390x/tokenizers-0.10.3-py38h7615e71_1.tar.bz2  3 years and 8 months ago 20 main
conda 3.0 MB | linux-s390x/tokenizers-0.10.3-py39h7615e71_1.tar.bz2  3 years and 8 months ago 20 main
conda 3.0 MB | linux-s390x/tokenizers-0.10.3-py37h7615e71_1.tar.bz2  3 years and 8 months ago 20 main
conda 3.0 MB | linux-s390x/tokenizers-0.10.3-py310h7615e71_1.tar.bz2  3 years and 8 months ago 20 main
conda 2.8 MB | linux-aarch64/tokenizers-0.10.3-py39h3c2c533_1.tar.bz2  3 years and 8 months ago 22 main
conda 2.8 MB | linux-aarch64/tokenizers-0.10.3-py38h3c2c533_1.tar.bz2  3 years and 8 months ago 22 main
conda 2.8 MB | linux-aarch64/tokenizers-0.10.3-py37h3c2c533_1.tar.bz2  3 years and 8 months ago 22 main
conda 2.8 MB | linux-aarch64/tokenizers-0.10.3-py310h3c2c533_1.tar.bz2  3 years and 8 months ago 25 main
conda 3.2 MB | linux-ppc64le/tokenizers-0.10.3-py310h83d0894_1.tar.bz2  3 years and 10 months ago 15 main
conda 8.5 kB | win-32/tokenizers-0.10.3-py310h01e58e6_1.tar.bz2  3 years and 11 months ago 24 main
conda 1.6 MB | win-32/tokenizers-0.10.3-py310h018781b_1.tar.bz2  3 years and 11 months ago 27 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py310h7bafbf5_1.tar.bz2  3 years and 11 months ago 32 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py310hb317417_1.tar.bz2  3 years and 11 months ago 318 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py39h7bafbf5_1.tar.bz2  4 years and 22 days ago 48 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy