About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 3.2 MB | linux-64/tokenizers-0.15.1-py311h22610ee_0.tar.bz2  2 years and 1 month ago 170 main
conda 3.2 MB | linux-64/tokenizers-0.15.1-py310h22610ee_0.tar.bz2  2 years and 1 month ago 390 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py39h49fca51_0.tar.bz2  2 years and 1 month ago 66 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py38h49fca51_0.tar.bz2  2 years and 1 month ago 46 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py311h49fca51_0.tar.bz2  2 years and 1 month ago 77 main
conda 2.0 MB | win-64/tokenizers-0.15.1-py310h49fca51_0.tar.bz2  2 years and 1 month ago 56 main
conda 2.3 MB | osx-arm64/tokenizers-0.15.1-py39h3dd52b7_0.tar.bz2  2 years and 1 month ago 24 main
conda 2.3 MB | osx-arm64/tokenizers-0.15.1-py38h3dd52b7_0.tar.bz2  2 years and 1 month ago 22 main
conda 2.3 MB | osx-arm64/tokenizers-0.15.1-py311h3dd52b7_0.tar.bz2  2 years and 1 month ago 26 main
conda 2.3 MB | osx-arm64/tokenizers-0.15.1-py310h3dd52b7_0.tar.bz2  2 years and 1 month ago 24 main
conda 2.2 MB | osx-64/tokenizers-0.15.1-py39h5240035_0.tar.bz2  2 years and 1 month ago 20 main
conda 2.2 MB | osx-64/tokenizers-0.15.1-py38h5240035_0.tar.bz2  2 years and 1 month ago 21 main
conda 2.2 MB | osx-64/tokenizers-0.15.1-py310h5240035_0.tar.bz2  2 years and 1 month ago 20 main
conda 2.2 MB | osx-64/tokenizers-0.15.1-py311h5240035_0.tar.bz2  2 years and 1 month ago 20 main
conda 3.3 MB | linux-s390x/tokenizers-0.15.1-py39ha9e02f1_0.tar.bz2  2 years and 1 month ago 16 main
conda 3.3 MB | linux-s390x/tokenizers-0.15.1-py38ha9e02f1_0.tar.bz2  2 years and 1 month ago 16 main
conda 3.3 MB | linux-s390x/tokenizers-0.15.1-py310ha9e02f1_0.tar.bz2  2 years and 1 month ago 16 main
conda 3.3 MB | linux-s390x/tokenizers-0.15.1-py311ha9e02f1_0.tar.bz2  2 years and 1 month ago 16 main
conda 3.2 MB | linux-aarch64/tokenizers-0.15.1-py39hb4c1b22_0.tar.bz2  2 years and 1 month ago 17 main
conda 3.2 MB | linux-aarch64/tokenizers-0.15.1-py310hb4c1b22_0.tar.bz2  2 years and 1 month ago 15 main
conda 3.3 MB | linux-aarch64/tokenizers-0.15.1-py311hb4c1b22_0.tar.bz2  2 years and 1 month ago 15 main
conda 3.2 MB | linux-aarch64/tokenizers-0.15.1-py38hb4c1b22_0.tar.bz2  2 years and 1 month ago 15 main
conda 3.4 MB | win-64/tokenizers-0.13.3-py312h49fca51_0.tar.bz2  2 years and 4 months ago 69 main
conda 4.8 MB | linux-s390x/tokenizers-0.13.3-py312ha9e02f1_0.tar.bz2  2 years and 4 months ago 18 main
conda 3.5 MB | osx-64/tokenizers-0.13.3-py312h5240035_0.tar.bz2  2 years and 4 months ago 20 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.15) Legal | Privacy Policy