About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-staging / tokenizers
Type Size Name Uploaded Downloads Labels
conda 2.0 MB | osx-64/tokenizers-0.21.1-py310h5714b29_0.conda  1 day and 20 hours ago 21 main
conda 1.9 MB | osx-arm64/tokenizers-0.21.1-py39hb8ba7bf_0.conda  1 day and 20 hours ago 32 main
conda 1.8 MB | win-64/tokenizers-0.21.1-py39hb5dfeee_0.conda  1 day and 20 hours ago 58 main
conda 1.8 MB | win-64/tokenizers-0.21.1-py312h21dd274_0.conda  1 day and 20 hours ago 136 main
conda 1.8 MB | win-64/tokenizers-0.21.1-py311h49ce162_0.conda  1 day and 20 hours ago 223 main
conda 1.8 MB | win-64/tokenizers-0.21.1-py313hbcc60ab_0.conda  1 day and 20 hours ago 39 main
conda 1.8 MB | win-64/tokenizers-0.21.1-py310hddca29c_0.conda  1 day and 20 hours ago 82 main
conda 2.3 MB | linux-aarch64/tokenizers-0.21.1-py311h5e37e04_0.conda  1 day and 20 hours ago 15 main
conda 2.0 MB | osx-64/tokenizers-0.21.1-py312h70a57c7_0.conda  1 day and 20 hours ago 53 main
conda 2.0 MB | osx-64/tokenizers-0.21.1-py311he5dd44f_0.conda  1 day and 20 hours ago 45 main
conda 1.9 MB | osx-arm64/tokenizers-0.21.1-py311h82b0fb8_0.conda  1 day and 20 hours ago 140 main
conda 1.9 MB | osx-arm64/tokenizers-0.21.1-py310h5c49f5a_0.conda  1 day and 20 hours ago 71 main
conda 2.3 MB | linux-aarch64/tokenizers-0.21.1-py313h5e73428_0.conda  1 day and 20 hours ago 15 main
conda 2.4 MB | linux-ppc64le/tokenizers-0.21.1-py311hd880925_0.conda  1 day and 20 hours ago 7 main
conda 1.9 MB | osx-arm64/tokenizers-0.21.1-py313h9a4dfeb_0.conda  1 day and 20 hours ago 29 main
conda 2.3 MB | linux-aarch64/tokenizers-0.21.1-py312ha0d6ea1_0.conda  1 day and 20 hours ago 124 main
conda 2.0 MB | osx-64/tokenizers-0.21.1-py313h108d750_0.conda  1 day and 20 hours ago 16 main
conda 1.9 MB | osx-arm64/tokenizers-0.21.1-py312hf3e4074_0.conda  1 day and 20 hours ago 208 main
conda 2.3 MB | linux-aarch64/tokenizers-0.21.1-py310h7f35fa6_0.conda  1 day and 20 hours ago 25 main
conda 2.0 MB | osx-64/tokenizers-0.21.1-py39hde49db8_0.conda  1 day and 20 hours ago 18 main
conda 2.4 MB | linux-ppc64le/tokenizers-0.21.1-py310h1654a2d_0.conda  1 day and 20 hours ago 7 main
conda 2.3 MB | linux-aarch64/tokenizers-0.21.1-py39h1c075fb_0.conda  1 day and 20 hours ago 13 main
conda 2.4 MB | linux-ppc64le/tokenizers-0.21.1-py39h3fe1aa8_0.conda  1 day and 20 hours ago 6 main
conda 2.2 MB | linux-64/tokenizers-0.21.1-py310hb1c6e2c_0.conda  1 day and 20 hours ago 496 main
conda 2.4 MB | linux-ppc64le/tokenizers-0.21.1-py312hda4bc3c_0.conda  1 day and 20 hours ago 7 main
conda 2.4 MB | linux-ppc64le/tokenizers-0.21.1-py313h0356731_0.conda  1 day and 20 hours ago 7 main
conda 2.2 MB | linux-64/tokenizers-0.21.1-py311h182c674_0.conda  1 day and 20 hours ago 241 main
conda 2.2 MB | linux-64/tokenizers-0.21.1-py39he41eae5_0.conda  1 day and 20 hours ago 129 main
conda 2.2 MB | linux-64/tokenizers-0.21.1-py312h8360d73_0.conda  1 day and 20 hours ago 361 main
conda 2.2 MB | linux-64/tokenizers-0.21.1-py313h1191936_0.conda  1 day and 20 hours ago 50 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy