About Anaconda Help Download Anaconda

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from huggingface / tokenizers
Type Size Name Uploaded Downloads Labels
conda 5.1 MB | linux-ppc64le/tokenizers-0.12.1-py37hf48d224_1.tar.bz2  2 years and 6 months ago 1 main
conda 5.1 MB | linux-ppc64le/tokenizers-0.12.1-py39hd5758d5_1.tar.bz2  2 years and 6 months ago 1 main
conda 3.2 MB | osx-arm64/tokenizers-0.12.1-py39hae86270_1.tar.bz2  2 years and 6 months ago 55 main
conda 3.4 MB | osx-64/tokenizers-0.12.1-py38h1f9fd9c_1.tar.bz2  2 years and 6 months ago 2 main
conda 3.2 MB | osx-arm64/tokenizers-0.12.1-py38h639d00c_1.tar.bz2  2 years and 6 months ago 5 main
conda 3.3 MB | osx-64/tokenizers-0.12.1-py37he7f1415_1.tar.bz2  2 years and 6 months ago 1 main
conda 3.4 MB | osx-64/tokenizers-0.12.1-py39h656764e_1.tar.bz2  2 years and 6 months ago 36 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py37hfb4b0a8_1.tar.bz2  2 years and 6 months ago 2 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py38h8bed557_1.tar.bz2  2 years and 6 months ago 0 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py37hb522d4f_1.tar.bz2  2 years and 6 months ago 9 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py38hb35c9e2_1.tar.bz2  2 years and 6 months ago 40 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py39h4d2953e_1.tar.bz2  2 years and 6 months ago 6 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py39h9da951c_1.tar.bz2  2 years and 6 months ago 1 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py37h86dd35e_1.tar.bz2  2 years and 6 months ago 0 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py37h579dcf0_1.tar.bz2  2 years and 6 months ago 0 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py38h7353dcf_1.tar.bz2  2 years and 6 months ago 1 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py38h2c0fd3b_1.tar.bz2  2 years and 6 months ago 0 main
conda 4.5 MB | linux-aarch64/tokenizers-0.12.1-py39h09f3788_1.tar.bz2  2 years and 6 months ago 1 main
conda 4.5 MB | linux-64/tokenizers-0.12.1-py39h3045328_1.tar.bz2  2 years and 6 months ago 254 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py37h8ff4856_0.tar.bz2  2 years and 7 months ago 0 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py39h0ae05b8_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py39h8c9392a_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py38h291c280_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.0 MB | win-64/tokenizers-0.12.1-py37h537c2b9_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.1 MB | osx-arm64/tokenizers-0.12.1-py39h95755d3_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py39ha9c964b_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.1 MB | osx-arm64/tokenizers-0.12.1-py38hf0d1e3c_0.tar.bz2  2 years and 7 months ago 0 main
conda 4.9 MB | linux-ppc64le/tokenizers-0.12.1-py38h21bfc59_0.tar.bz2  2 years and 7 months ago 0 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py38h8c440c4_0.tar.bz2  2 years and 7 months ago 1 main
conda 3.2 MB | osx-64/tokenizers-0.12.1-py37h2203242_0.tar.bz2  2 years and 7 months ago 0 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py38ha50258e_0.tar.bz2  2 years and 7 months ago 2 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py37h2c05718_0.tar.bz2  2 years and 7 months ago 0 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py38h63c213b_0.tar.bz2  2 years and 7 months ago 57 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py37h18700ff_0.tar.bz2  2 years and 7 months ago 23 main
conda 4.3 MB | linux-64/tokenizers-0.12.1-py39h312a7cb_0.tar.bz2  2 years and 7 months ago 132 main
conda 4.3 MB | linux-aarch64/tokenizers-0.12.1-py39h5854805_0.tar.bz2  2 years and 7 months ago 5 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 6 months ago 2 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 6 months ago 0 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 6 months ago 1 main
conda 1.9 MB | win-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 6 months ago 4 main
conda 1.9 MB | win-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 6 months ago 3 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 6 months ago 1 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py37_0.tar.bz2  3 years and 6 months ago 0 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py38_0.tar.bz2  3 years and 6 months ago 22 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py36_0.tar.bz2  3 years and 6 months ago 2 main
conda 2.0 MB | osx-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 6 months ago 1 main
conda 1.8 MB | win-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 6 months ago 1 main
conda 2.8 MB | linux-64/tokenizers-0.10.3-py35_0.tar.bz2  3 years and 6 months ago 1 main

© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy