About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud
If you were automatically logged out you may need to refresh the page. You're trying to access a page that requires authentication. ×

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 1.7 MB | win-64/tokenizers-0.9.3-py37h537c2b9_0.tar.bz2  4 years and 2 months ago 367 main
conda 1.7 MB | win-64/tokenizers-0.9.3-py38h291c280_0.tar.bz2  4 years and 2 months ago 372 main
conda 1.7 MB | win-64/tokenizers-0.9.3-py36h01e22a4_0.tar.bz2  4 years and 2 months ago 362 main
conda 1.8 MB | osx-64/tokenizers-0.9.3-py36hc3ca637_0.tar.bz2  4 years and 2 months ago 246 main
conda 1.8 MB | osx-64/tokenizers-0.9.3-py37h7bba54e_0.tar.bz2  4 years and 2 months ago 250 main
conda 2.6 MB | linux-64/tokenizers-0.9.3-py37h17e0dd7_0.tar.bz2  4 years and 2 months ago 1982 main
conda 1.8 MB | osx-64/tokenizers-0.9.3-py38h0582b0e_0.tar.bz2  4 years and 2 months ago 244 main
conda 2.6 MB | linux-64/tokenizers-0.9.3-py36h2bc52f9_0.tar.bz2  4 years and 2 months ago 1982 main
conda 2.6 MB | linux-64/tokenizers-0.9.3-py38h781e378_0.tar.bz2  4 years and 2 months ago 1985 main
conda 2.6 MB | linux-64/tokenizers-0.9.3-py36hc84fb85_0.tar.bz2  4 years and 2 months ago 1940 main
conda 1.8 MB | osx-64/tokenizers-0.9.3-py36h999cc91_0.tar.bz2  4 years and 2 months ago 249 main
© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.7) Legal | Privacy Policy