About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 4.4 MB | linux-64/tokenizers-0.13.1-py37hb522d4f_0.tar.bz2  3 years and 2 months ago 5003 main
conda 4.4 MB | linux-64/tokenizers-0.13.1-py310h633acb5_0.tar.bz2  3 years and 2 months ago 2034 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py37h579dcf0_0.tar.bz2  3 years and 2 months ago 87 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py38h2c0fd3b_0.tar.bz2  3 years and 2 months ago 82 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py38h7353dcf_0.tar.bz2  3 years and 2 months ago 80 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py310h6a5eb97_0.tar.bz2  3 years and 2 months ago 79 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py39h9da951c_0.tar.bz2  3 years and 2 months ago 111 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py39h09f3788_0.tar.bz2  3 years and 2 months ago 80 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py37h86dd35e_0.tar.bz2  3 years and 2 months ago 101 main
conda 4.5 MB | linux-aarch64/tokenizers-0.13.1-py310h4676ddf_0.tar.bz2  3 years and 2 months ago 100 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy