About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 2.7 MB | osx-arm64/tokenizers-0.13.2-py38hf11c49c_0.conda  3 years and 2 months ago 818 main
conda 2.7 MB | osx-arm64/tokenizers-0.13.2-py310he8402e3_0.conda  3 years and 2 months ago 1513 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py39h01ec81f_0.conda  3 years and 2 months ago 9291 main
conda 3.8 MB | linux-64/tokenizers-0.13.2-py311hd13c131_0.conda  3 years and 2 months ago 4097 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py38haefcc50_0.conda  3 years and 2 months ago 5516 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py310h26b42ff_0.conda  3 years and 2 months ago 24826 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py38h5274fd1_0.conda  3 years and 2 months ago 44387 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py39h585fa2d_0.conda  3 years and 2 months ago 10324 main
conda 3.7 MB | linux-64/tokenizers-0.13.2-py310he1f1126_0.conda  3 years and 2 months ago 15850 main
conda 3.8 MB | linux-64/tokenizers-0.13.2-py311h1b04a43_0.conda  3 years and 2 months ago 5214 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.17) Legal | Privacy Policy