About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 3.4 MB | win-64/tokenizers-0.13.3-py312h49fca51_0.tar.bz2  2 years and 1 month ago 68 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py312ha9e02f1_0.tar.bz2  2 years and 1 month ago 17 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py312h5240035_0.tar.bz2  2 years and 1 month ago 19 main
conda 3.7 MB | osx-arm64/tokenizers-0.13.3-py312h3dd52b7_0.tar.bz2  2 years and 1 month ago 32 main
conda 4.8 MB | linux-64/tokenizers-0.13.3-py312h22610ee_0.tar.bz2  2 years and 1 month ago 96 main
conda 4.8 MB | linux-aarch64/tokenizers-0.13.3-py312hb4c1b22_0.tar.bz2  2 years and 1 month ago 14 main
conda 3.3 MB | win-64/tokenizers-0.13.3-py38h49fca51_0.tar.bz2  2 years and 2 months ago 483 main
conda 3.3 MB | win-64/tokenizers-0.13.3-py311h49fca51_0.tar.bz2  2 years and 2 months ago 907 main
conda 3.3 MB | win-64/tokenizers-0.13.3-py39h49fca51_0.tar.bz2  2 years and 2 months ago 764 main
conda 3.3 MB | win-64/tokenizers-0.13.3-py310h49fca51_0.tar.bz2  2 years and 2 months ago 388 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py39h5240035_0.tar.bz2  2 years and 2 months ago 84 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py38h5240035_0.tar.bz2  2 years and 2 months ago 78 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py311h5240035_0.tar.bz2  2 years and 2 months ago 121 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py310h5240035_0.tar.bz2  2 years and 2 months ago 77 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py39ha9e02f1_0.tar.bz2  2 years and 2 months ago 17 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py38ha9e02f1_0.tar.bz2  2 years and 2 months ago 16 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py311ha9e02f1_0.tar.bz2  2 years and 2 months ago 15 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py310ha9e02f1_0.tar.bz2  2 years and 2 months ago 16 main
conda 5.2 MB | linux-ppc64le/tokenizers-0.13.3-py39h3d4f45a_0.tar.bz2  2 years and 2 months ago 13 main
conda 5.2 MB | linux-ppc64le/tokenizers-0.13.3-py38h3d4f45a_0.tar.bz2  2 years and 2 months ago 11 main
conda 5.2 MB | linux-ppc64le/tokenizers-0.13.3-py310h3d4f45a_0.tar.bz2  2 years and 2 months ago 30 main
conda 5.3 MB | linux-ppc64le/tokenizers-0.13.3-py311h3d4f45a_0.tar.bz2  2 years and 2 months ago 15 main
conda 4.8 MB | linux-aarch64/tokenizers-0.13.3-py39hb4c1b22_0.tar.bz2  2 years and 2 months ago 22 main
conda 4.8 MB | linux-aarch64/tokenizers-0.13.3-py38hb4c1b22_0.tar.bz2  2 years and 2 months ago 24 main
conda 4.8 MB | linux-aarch64/tokenizers-0.13.3-py311hb4c1b22_0.tar.bz2  2 years and 2 months ago 30 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy