About Anaconda Help Download Anaconda
Sign In
Anaconda.cloud

conda-forge / packages / tokenizers

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-staging / tokenizers

Filters
Type Size Name Uploaded Downloads Labels
conda 1.7 MB | osx-64/tokenizers-0.8.0-py37h4c3b196_1.tar.bz2  4 years and 5 months ago 317 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py36h327c840_1.tar.bz2  4 years and 5 months ago 314 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py36hf1545a4_1.tar.bz2  4 years and 5 months ago 325 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py38h2cef62f_1.tar.bz2  4 years and 5 months ago 320 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py38h2cef62f_1.tar.bz2  4 years and 5 months ago 2256 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py37h4c3b196_1.tar.bz2  4 years and 5 months ago 2296 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py36h327c840_1.tar.bz2  4 years and 5 months ago 2232 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py36hf1545a4_1.tar.bz2  4 years and 5 months ago 2226 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py37h4c3b196_0.tar.bz2  4 years and 5 months ago 329 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py38h2cef62f_0.tar.bz2  4 years and 5 months ago 323 main
conda 1.7 MB | osx-64/tokenizers-0.8.0-py36hf1545a4_0.tar.bz2  4 years and 5 months ago 323 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py38h2cef62f_0.tar.bz2  4 years and 5 months ago 2258 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py37h4c3b196_0.tar.bz2  4 years and 5 months ago 2277 main
conda 2.5 MB | linux-64/tokenizers-0.8.0-py36hf1545a4_0.tar.bz2  4 years and 5 months ago 2233 main
© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy