About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud

anaconda / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters
Type Size Name Uploaded Downloads Labels
conda 4.4 MB | linux-64/tokenizers-0.11.4-py310h3dcd8bd_1.tar.bz2  2 years and 11 months ago 1537 main
conda 4.4 MB | linux-64/tokenizers-0.11.4-py37h3dcd8bd_1.tar.bz2  2 years and 11 months ago 424 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py39h5c5695e_0.tar.bz2  2 years and 11 months ago 19 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py310h5c5695e_0.tar.bz2  2 years and 11 months ago 17 main
conda 3.2 MB | osx-arm64/tokenizers-0.11.4-py38h5c5695e_0.tar.bz2  2 years and 11 months ago 14 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.1.0) Legal | Privacy Policy