About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 4.4 MB | linux-64/tokenizers-0.13.1-py37hb522d4f_0.tar.bz2  3 years and 2 months ago 5030 main
conda 4.4 MB | linux-64/tokenizers-0.13.1-py310h633acb5_0.tar.bz2  3 years and 2 months ago 2047 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py37h579dcf0_0.tar.bz2  3 years and 2 months ago 88 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py38h2c0fd3b_0.tar.bz2  3 years and 2 months ago 83 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py38h7353dcf_0.tar.bz2  3 years and 2 months ago 81 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py310h6a5eb97_0.tar.bz2  3 years and 2 months ago 80 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py39h9da951c_0.tar.bz2  3 years and 2 months ago 112 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py39h09f3788_0.tar.bz2  3 years and 2 months ago 81 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py37h86dd35e_0.tar.bz2  3 years and 2 months ago 102 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py310h4676ddf_0.tar.bz2  3 years and 2 months ago 101 main
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy