About Anaconda Help Download Anaconda
Sign In
Anaconda.com

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py311h120959f_0.tar.bz2  1 year and 4 months ago 40 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py310he44fafa_0.tar.bz2  1 year and 4 months ago 23 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py38h2cb190a_0.tar.bz2  1 year and 4 months ago 23 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py39h2cb190a_0.tar.bz2  1 year and 4 months ago 21 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py312h366ea60_0.tar.bz2  1 year and 4 months ago 20 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py311h6aa045b_0.tar.bz2  1 year and 4 months ago 22 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py310h2cb190a_0.tar.bz2  1 year and 4 months ago 25 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py39h22b401c_0.tar.bz2  1 year and 4 months ago 16 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py38h22b401c_0.tar.bz2  1 year and 4 months ago 15 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py312h11ba2a4_0.tar.bz2  1 year and 4 months ago 16 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py311h8a5b679_0.tar.bz2  1 year and 4 months ago 16 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py38h70553a4_0.tar.bz2  1 year and 4 months ago 19 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py310h22b401c_0.tar.bz2  1 year and 4 months ago 15 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py39h70553a4_0.tar.bz2  1 year and 4 months ago 27 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py312h7c1c461_0.tar.bz2  1 year and 4 months ago 17 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py311heb56449_0.tar.bz2  1 year and 4 months ago 20 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py39h7d74088_0.tar.bz2  1 year and 4 months ago 58 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py310h70553a4_0.tar.bz2  1 year and 4 months ago 19 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py311h766900b_0.tar.bz2  1 year and 4 months ago 64 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py312h28f53f8_0.tar.bz2  1 year and 4 months ago 102 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py38h7d74088_0.tar.bz2  1 year and 4 months ago 172 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py310h7d74088_0.tar.bz2  1 year and 4 months ago 272 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py312hc899e84_0.tar.bz2  1 year and 7 months ago 99 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py39h7ac788d_0.tar.bz2  1 year and 7 months ago 65 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py38h7ac788d_0.tar.bz2  1 year and 7 months ago 62 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.14) Legal | Privacy Policy