About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 3.0 MB | win-64/tokenizers-0.11.4-py39he5181cf_1.tar.bz2  3 years and 7 months ago 1142 main
conda 3.0 MB | win-64/tokenizers-0.11.4-py38he5181cf_1.tar.bz2  3 years and 7 months ago 524 main
conda 3.0 MB | win-64/tokenizers-0.11.4-py37he5181cf_1.tar.bz2  3 years and 7 months ago 195 main
conda 3.0 MB | win-64/tokenizers-0.11.4-py310he5181cf_1.tar.bz2  3 years and 7 months ago 2320 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py39h5c5695e_1.tar.bz2  3 years and 7 months ago 120 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py38h5c5695e_1.tar.bz2  3 years and 7 months ago 124 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py310h5c5695e_1.tar.bz2  3 years and 7 months ago 173 main
conda 3.3 MB | osx-64/tokenizers-0.11.4-py39h8776b5c_1.tar.bz2  3 years and 7 months ago 110 main
conda 3.3 MB | osx-64/tokenizers-0.11.4-py38h8776b5c_1.tar.bz2  3 years and 7 months ago 108 main
conda 3.3 MB | osx-64/tokenizers-0.11.4-py37h8776b5c_1.tar.bz2  3 years and 7 months ago 50 main
conda 3.3 MB | osx-64/tokenizers-0.11.4-py310h8776b5c_1.tar.bz2  3 years and 7 months ago 175 main
conda 4.4 MB | linux-s390x/tokenizers-0.11.4-py39h0709fce_1.tar.bz2  3 years and 7 months ago 19 main
conda 4.4 MB | linux-s390x/tokenizers-0.11.4-py38h0709fce_1.tar.bz2  3 years and 7 months ago 18 main
conda 4.4 MB | linux-s390x/tokenizers-0.11.4-py37h0709fce_1.tar.bz2  3 years and 7 months ago 18 main
conda 4.4 MB | linux-s390x/tokenizers-0.11.4-py310h0709fce_1.tar.bz2  3 years and 7 months ago 19 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.11.4-py39h32fc9c6_1.tar.bz2  3 years and 7 months ago 15 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.11.4-py38h32fc9c6_1.tar.bz2  3 years and 7 months ago 15 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.11.4-py37h32fc9c6_1.tar.bz2  3 years and 7 months ago 16 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.11.4-py310h32fc9c6_1.tar.bz2  3 years and 7 months ago 15 main
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py39h81d793f_1.tar.bz2  3 years and 7 months ago 22 main
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py38h81d793f_1.tar.bz2  3 years and 7 months ago 19 main
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py37h81d793f_1.tar.bz2  3 years and 7 months ago 25 main
conda 4.4 MB | linux-aarch64/tokenizers-0.11.4-py310h81d793f_1.tar.bz2  3 years and 7 months ago 70 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py39h3dcd8bd_1.tar.bz2  3 years and 7 months ago 1121 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py38h3dcd8bd_1.tar.bz2  3 years and 7 months ago 1743 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy