Tokenizers | Anaconda.org

rocketce-test / packages / tokenizers 0.15.2

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Conda
Files
Labels
Badges

License: Apache-2.0
Home: https://pypi.org/project/tokenizers/
Development: https://github.com/huggingface/tokenizers
0 total downloads
Last upload: 1 month and 13 days ago

Installers

Info: This package contains files in non-standard labels.

linux-ppc64le v0.15.2

conda install

To install this package run one of the following:
conda install rocketce-test::tokenizers
conda install rocketce-test/label/rocketce-1.11.5::tokenizers

rocketce-test / packages / tokenizers 0.15.2

0

Installers

conda install

Description

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy

rocketce-test / packages / tokenizers 0.15.2 0

Installers

conda install

Description

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.9) Legal | Privacy Policy

rocketce-test / packages / tokenizers 0.15.2

0