About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py39hfc91441_1.tar.bz2  4 years and 1 day ago 11929 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_1.tar.bz2  4 years and 1 day ago 12302 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py37h21574f2_1.tar.bz2  4 years and 1 day ago 140 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py36hd885b9d_1.tar.bz2  4 years and 1 day ago 117 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py38h291c280_1.tar.bz2  4 years and 1 day ago 3700 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py36h01e22a4_1.tar.bz2  4 years and 1 day ago 2288 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py37h537c2b9_1.tar.bz2  4 years and 1 day ago 2117 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py39h8c9392a_1.tar.bz2  4 years and 1 day ago 4303 main
conda 1.9 MB | osx-arm64/tokenizers-0.10.3-py38he82c38c_1.tar.bz2  4 years and 1 day ago 1692 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py37hd52b43c_1.tar.bz2  4 years and 1 day ago 618 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py38h7d8d1bc_1.tar.bz2  4 years and 1 day ago 1119 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py36h95e621a_1.tar.bz2  4 years and 1 day ago 514 main
conda 1.9 MB | osx-arm64/tokenizers-0.10.3-py39hab32027_1.tar.bz2  4 years and 1 day ago 2088 main
conda 5.1 MB | linux-ppc64le/tokenizers-0.10.3-py38ha05bbb4_1.tar.bz2  4 years and 1 day ago 121 main
conda 5.0 MB | linux-ppc64le/tokenizers-0.10.3-py39h709bb41_1.tar.bz2  4 years and 1 day ago 115 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py39h1c16480_1.tar.bz2  4 years and 1 day ago 2594 main
conda 4.6 MB | linux-64/tokenizers-0.10.3-py37hcb7a40c_1.tar.bz2  4 years and 1 day ago 6933 main
conda 5.1 MB | linux-ppc64le/tokenizers-0.10.3-py36h868246f_1.tar.bz2  4 years and 1 day ago 80 main
conda 5.1 MB | linux-ppc64le/tokenizers-0.10.3-py37hde4f5c7_1.tar.bz2  4 years and 1 day ago 88 main
conda 4.6 MB | linux-64/tokenizers-0.10.3-py36h589faa6_1.tar.bz2  4 years and 1 day ago 4259 main
conda 4.6 MB | linux-64/tokenizers-0.10.3-py39hd6d55de_1.tar.bz2  4 years and 1 day ago 628614 main
conda 4.6 MB | linux-64/tokenizers-0.10.3-py38hb63a372_1.tar.bz2  4 years and 1 day ago 42406 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py39hfc91441_0.tar.bz2  4 years and 2 days ago 93 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_0.tar.bz2  4 years and 2 days ago 91 main
conda 4.6 MB | linux-aarch64/tokenizers-0.10.3-py37h21574f2_0.tar.bz2  4 years and 2 days ago 96 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2) Legal | Privacy Policy