About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-staging / tokenizers
Type Size Name Uploaded Downloads Labels
conda 1.8 MB | win-64/tokenizers-0.9.4-py39h8c9392a_1.tar.bz2  4 years and 2 months ago 1168 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py38h291c280_1.tar.bz2  4 years and 2 months ago 1385 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py36h01e22a4_1.tar.bz2  4 years and 2 months ago 728 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py37h537c2b9_1.tar.bz2  4 years and 2 months ago 2356 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py38h0582b0e_1.tar.bz2  4 years and 2 months ago 1125 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36h999cc91_1.tar.bz2  4 years and 2 months ago 957 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py38h781e378_1.tar.bz2  4 years and 2 months ago 8183 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py37h17e0dd7_1.tar.bz2  4 years and 2 months ago 31948 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36h2bc52f9_1.tar.bz2  4 years and 2 months ago 4788 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36hc84fb85_1.tar.bz2  4 years and 2 months ago 1969 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36hc3ca637_1.tar.bz2  4 years and 2 months ago 252 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py39h289741d_1.tar.bz2  4 years and 2 months ago 3484 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py37h7bba54e_1.tar.bz2  4 years and 2 months ago 1425 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py39h702b19a_1.tar.bz2  4 years and 2 months ago 372 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py36h01e22a4_0.tar.bz2  4 years and 2 months ago 345 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py37h537c2b9_0.tar.bz2  4 years and 2 months ago 351 main
conda 1.8 MB | win-64/tokenizers-0.9.4-py38h291c280_0.tar.bz2  4 years and 2 months ago 363 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36hc84fb85_0.tar.bz2  4 years and 2 months ago 1936 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py37h17e0dd7_0.tar.bz2  4 years and 2 months ago 1961 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py36h2bc52f9_0.tar.bz2  4 years and 2 months ago 1922 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36h999cc91_0.tar.bz2  4 years and 2 months ago 243 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py38h0582b0e_0.tar.bz2  4 years and 2 months ago 245 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py36hc3ca637_0.tar.bz2  4 years and 2 months ago 248 main
conda 1.8 MB | osx-64/tokenizers-0.9.4-py37h7bba54e_0.tar.bz2  4 years and 2 months ago 253 main
conda 2.6 MB | linux-64/tokenizers-0.9.4-py38h781e378_0.tar.bz2  4 years and 2 months ago 1978 main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy