About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 1.8 MB | osx-arm64/tokenizers-0.15.0-py310h4a533d7_0.conda  1 year and 10 months ago 384 main
conda 3.0 MB | linux-ppc64le/tokenizers-0.15.0-py311h375a143_0.conda  1 year and 10 months ago 191 main
conda 1.8 MB | osx-arm64/tokenizers-0.15.0-py312he12b74c_0.conda  1 year and 10 months ago 346 main
conda 1.8 MB | osx-arm64/tokenizers-0.15.0-py38h41a3331_0.conda  1 year and 10 months ago 329 main
conda 2.8 MB | linux-64/tokenizers-0.15.0-py38hf65db12_0.conda  1 year and 10 months ago 1807 main
conda 2.8 MB | linux-64/tokenizers-0.15.0-py311h6640629_0.conda  1 year and 10 months ago 2141 main
conda 2.8 MB | linux-64/tokenizers-0.15.0-py39hc62d755_0.conda  1 year and 10 months ago 1940 main
conda 2.8 MB | linux-64/tokenizers-0.15.0-py312hfef1a59_0.conda  1 year and 10 months ago 1754 main
conda 2.8 MB | linux-64/tokenizers-0.15.0-py310h320607d_0.conda  1 year and 10 months ago 2669 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2) Legal | Privacy Policy