About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 4.3 MB | linux-aarch64/tokenizers-0.11.0-py39hfc91441_0.tar.bz2  3 years and 8 months ago 81 main
conda 4.3 MB | linux-aarch64/tokenizers-0.11.0-py37h21574f2_0.tar.bz2  3 years and 8 months ago 82 main
conda 4.3 MB | linux-aarch64/tokenizers-0.11.0-py38h0a8abf9_0.tar.bz2  3 years and 8 months ago 81 main
conda 3.0 MB | win-64/tokenizers-0.11.0-py38h291c280_0.tar.bz2  3 years and 8 months ago 159 main
conda 3.0 MB | win-64/tokenizers-0.11.0-py37h537c2b9_0.tar.bz2  3 years and 8 months ago 149 main
conda 3.0 MB | win-64/tokenizers-0.11.0-py39h8c9392a_0.tar.bz2  3 years and 8 months ago 711 main
conda 5.0 MB | linux-ppc64le/tokenizers-0.11.0-py39h709bb41_0.tar.bz2  3 years and 8 months ago 56 main
conda 5.0 MB | linux-ppc64le/tokenizers-0.11.0-py38ha05bbb4_0.tar.bz2  3 years and 8 months ago 52 main
conda 3.3 MB | osx-64/tokenizers-0.11.0-py38h7d8d1bc_0.tar.bz2  3 years and 8 months ago 91 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.0-py38he82c38c_0.tar.bz2  3 years and 8 months ago 97 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.0-py39hab32027_0.tar.bz2  3 years and 8 months ago 97 main
conda 3.3 MB | osx-64/tokenizers-0.11.0-py37hd52b43c_0.tar.bz2  3 years and 8 months ago 90 main
conda 3.3 MB | osx-64/tokenizers-0.11.0-py39h1c16480_0.tar.bz2  3 years and 8 months ago 95 main
conda 5.0 MB | linux-ppc64le/tokenizers-0.11.0-py37hde4f5c7_0.tar.bz2  3 years and 8 months ago 53 main
conda 4.3 MB | linux-64/tokenizers-0.11.0-py37hcb7a40c_0.tar.bz2  3 years and 8 months ago 2048 main
conda 4.3 MB | linux-64/tokenizers-0.11.0-py38hb63a372_0.tar.bz2  3 years and 8 months ago 1950 main
conda 4.3 MB | linux-64/tokenizers-0.11.0-py39hd6d55de_0.tar.bz2  3 years and 8 months ago 2568 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2) Legal | Privacy Policy