About Anaconda Help Download Anaconda

main / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Type Size Name Uploaded Downloads Labels
conda 2.5 MB | linux-64/tokenizers-0.20.1-py310ha92566c_1.tar.bz2  4 months and 7 days ago 6154 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py311h5e3497e_1.tar.bz2  4 months and 7 days ago 15 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py39ha92566c_1.tar.bz2  4 months and 7 days ago 17 main
conda 2.5 MB | linux-64/tokenizers-0.20.1-py312h526025d_1.tar.bz2  4 months and 7 days ago 16 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py39h5bc1c3f_0.tar.bz2  5 months and 4 days ago 9 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py38h5bc1c3f_0.tar.bz2  5 months and 4 days ago 9 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py312h4b3af92_0.tar.bz2  5 months and 4 days ago 9 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py311h3eac673_0.tar.bz2  5 months and 4 days ago 11 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py310h5bc1c3f_0.tar.bz2  5 months and 4 days ago 8 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py39he44fafa_0.tar.bz2  5 months and 4 days ago 2 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py38he44fafa_0.tar.bz2  5 months and 4 days ago 3 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py312h654b0c7_0.tar.bz2  5 months and 4 days ago 2 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py311h120959f_0.tar.bz2  5 months and 4 days ago 5 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py310he44fafa_0.tar.bz2  5 months and 4 days ago 1 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py39h2cb190a_0.tar.bz2  5 months and 4 days ago 4 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py38h2cb190a_0.tar.bz2  5 months and 4 days ago 4 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py312h366ea60_0.tar.bz2  5 months and 4 days ago 4 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py311h6aa045b_0.tar.bz2  5 months and 4 days ago 3 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py310h2cb190a_0.tar.bz2  5 months and 4 days ago 4 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py39h22b401c_0.tar.bz2  5 months and 4 days ago 2 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py38h22b401c_0.tar.bz2  5 months and 4 days ago 2 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py312h11ba2a4_0.tar.bz2  5 months and 4 days ago 1 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py311h8a5b679_0.tar.bz2  5 months and 4 days ago 2 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py310h22b401c_0.tar.bz2  5 months and 4 days ago 2 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py39h70553a4_0.tar.bz2  5 months and 4 days ago 1 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.10) Legal | Privacy Policy