About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-staging / tokenizers
Type Size Name Uploaded Downloads Labels
conda 1.8 MB | win-64/tokenizers-0.9.4-py39h8c9392a_1.tar.bz2  4 years and 4 months ago 1181 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py38h291c280_1.tar.bz2  4 years and 4 months ago 1403 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py36h01e22a4_1.tar.bz2  4 years and 4 months ago 734 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py37h537c2b9_1.tar.bz2  4 years and 4 months ago 2394 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py38h0582b0e_1.tar.bz2  4 years and 4 months ago 1128 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36h999cc91_1.tar.bz2  4 years and 4 months ago 960 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py38h781e378_1.tar.bz2  4 years and 4 months ago 8394 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py37h17e0dd7_1.tar.bz2  4 years and 4 months ago 32198 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36h2bc52f9_1.tar.bz2  4 years and 4 months ago 4976 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36hc84fb85_1.tar.bz2  4 years and 4 months ago 2130 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36hc3ca637_1.tar.bz2  4 years and 4 months ago 254 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py39h289741d_1.tar.bz2  4 years and 4 months ago 3643 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py37h7bba54e_1.tar.bz2  4 years and 4 months ago 1430 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py39h702b19a_1.tar.bz2  4 years and 4 months ago 374 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py36h01e22a4_0.tar.bz2  4 years and 4 months ago 349 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py37h537c2b9_0.tar.bz2  4 years and 4 months ago 355 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py38h291c280_0.tar.bz2  4 years and 4 months ago 367 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36hc84fb85_0.tar.bz2  4 years and 4 months ago 2091 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py37h17e0dd7_0.tar.bz2  4 years and 4 months ago 2124 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36h2bc52f9_0.tar.bz2  4 years and 4 months ago 2088 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36h999cc91_0.tar.bz2  4 years and 4 months ago 245 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py38h0582b0e_0.tar.bz2  4 years and 4 months ago 247 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36hc3ca637_0.tar.bz2  4 years and 4 months ago 250 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py37h7bba54e_0.tar.bz2  4 years and 4 months ago 255 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py38h781e378_0.tar.bz2  4 years and 4 months ago 2148 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy