About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

Type Size Name Uploaded Downloads Labels
conda 2.4 MB | linux-aarch64/tokenizers-0.20.1-py39hdc1999c_1.tar.bz2  3 months and 21 days ago 33 main
conda 2.4 MB | linux-aarch64/tokenizers-0.20.1-py310hdc1999c_1.tar.bz2  3 months and 21 days ago 9 main
conda 2.4 MB | linux-aarch64/tokenizers-0.20.1-py311hf2d19f8_1.tar.bz2  3 months and 21 days ago 5 main
conda 2.4 MB | linux-aarch64/tokenizers-0.20.1-py312h377adab_1.tar.bz2  3 months and 21 days ago 25 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py39h5bc1c3f_0.tar.bz2  4 months and 18 days ago 19 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py38h5bc1c3f_0.tar.bz2  4 months and 18 days ago 48 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py312h4b3af92_0.tar.bz2  4 months and 18 days ago 27 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py311h3eac673_0.tar.bz2  4 months and 18 days ago 44 main
conda 2.2 MB | win-64/tokenizers-0.20.1-py310h5bc1c3f_0.tar.bz2  4 months and 18 days ago 16 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py39he44fafa_0.tar.bz2  4 months and 18 days ago 14 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py38he44fafa_0.tar.bz2  4 months and 18 days ago 14 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py312h654b0c7_0.tar.bz2  4 months and 18 days ago 20 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py311h120959f_0.tar.bz2  4 months and 18 days ago 24 main
conda 2.4 MB | osx-arm64/tokenizers-0.20.1-py310he44fafa_0.tar.bz2  4 months and 18 days ago 10 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py38h2cb190a_0.tar.bz2  4 months and 18 days ago 9 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py39h2cb190a_0.tar.bz2  4 months and 18 days ago 7 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py312h366ea60_0.tar.bz2  4 months and 18 days ago 8 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py311h6aa045b_0.tar.bz2  4 months and 18 days ago 9 main
conda 2.2 MB | osx-64/tokenizers-0.20.1-py310h2cb190a_0.tar.bz2  4 months and 18 days ago 13 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py39h22b401c_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py38h22b401c_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py312h11ba2a4_0.tar.bz2  4 months and 18 days ago 6 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py311h8a5b679_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py38h70553a4_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.3 MB | linux-s390x/tokenizers-0.20.1-py310h22b401c_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py39h70553a4_0.tar.bz2  4 months and 18 days ago 15 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py312h7c1c461_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py311heb56449_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py39h7d74088_0.tar.bz2  4 months and 18 days ago 30 main
conda 3.2 MB | linux-aarch64/tokenizers-0.20.1-py310h70553a4_0.tar.bz2  4 months and 18 days ago 5 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py311h766900b_0.tar.bz2  4 months and 18 days ago 37 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py312h28f53f8_0.tar.bz2  4 months and 18 days ago 72 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py38h7d74088_0.tar.bz2  4 months and 18 days ago 81 main
conda 3.2 MB | linux-64/tokenizers-0.20.1-py310h7d74088_0.tar.bz2  4 months and 18 days ago 230 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py312hc899e84_0.tar.bz2  7 months and 25 days ago 73 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py39h7ac788d_0.tar.bz2  7 months and 25 days ago 42 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py38h7ac788d_0.tar.bz2  7 months and 25 days ago 41 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py311h2da67c9_0.tar.bz2  7 months and 25 days ago 108 main
conda 2.0 MB | win-64/tokenizers-0.19.1-py310h7ac788d_0.tar.bz2  7 months and 25 days ago 219 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py39h92154f2_0.tar.bz2  7 months and 25 days ago 17 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py38h92154f2_0.tar.bz2  7 months and 25 days ago 12 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py312ha1e0277_0.tar.bz2  7 months and 25 days ago 31 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py311he19d34d_0.tar.bz2  7 months and 25 days ago 38 main
conda 2.2 MB | osx-arm64/tokenizers-0.19.1-py310h92154f2_0.tar.bz2  7 months and 25 days ago 23 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py39h1c4dec2_0.tar.bz2  7 months and 25 days ago 12 main
conda 2.2 MB | osx-64/tokenizers-0.19.1-py312hfa73619_0.tar.bz2  7 months and 25 days ago 11 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py38h1c4dec2_0.tar.bz2  7 months and 25 days ago 10 main
conda 2.2 MB | osx-64/tokenizers-0.19.1-py311hb453228_0.tar.bz2  7 months and 25 days ago 11 main
conda 2.1 MB | osx-64/tokenizers-0.19.1-py310h1c4dec2_0.tar.bz2  7 months and 25 days ago 16 main
conda 3.1 MB | linux-s390x/tokenizers-0.19.1-py39hf649420_0.tar.bz2  7 months and 25 days ago 9 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy