About Anaconda Help Download Anaconda
Sign In
Anaconda.com

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 4.5 MB | linux-64/tokenizers-0.12.1-py39h3045328_1.tar.bz2  3 years and 7 months ago 104511 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py37h8ff4856_0.tar.bz2  3 years and 8 months ago 68 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py39h0ae05b8_0.tar.bz2  3 years and 8 months ago 82 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py39h8c9392a_0.tar.bz2  3 years and 8 months ago 944 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py38h291c280_0.tar.bz2  3 years and 8 months ago 226 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py37h537c2b9_0.tar.bz2  3 years and 8 months ago 211 main
conda 3.1 MB | osx-arm64/tokenizers-0.12.1-py39h95755d3_0.tar.bz2  3 years and 8 months ago 295 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py39ha9c964b_0.tar.bz2  3 years and 8 months ago 146 main
conda 3.1 MB | osx-arm64/tokenizers-0.12.1-py38hf0d1e3c_0.tar.bz2  3 years and 8 months ago 277 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py38h21bfc59_0.tar.bz2  3 years and 8 months ago 75 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py38h8c440c4_0.tar.bz2  3 years and 8 months ago 142 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py37h2203242_0.tar.bz2  3 years and 8 months ago 123 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py38ha50258e_0.tar.bz2  3 years and 8 months ago 118 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py37h2c05718_0.tar.bz2  3 years and 8 months ago 104 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py38h63c213b_0.tar.bz2  3 years and 8 months ago 4451 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py37h18700ff_0.tar.bz2  3 years and 8 months ago 3563 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py39h312a7cb_0.tar.bz2  3 years and 8 months ago 5563 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py39h5854805_0.tar.bz2  3 years and 8 months ago 143 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.13) Legal | Privacy Policy