Tokenizers | Anaconda.org

services-build-deps / packages / tokenizers 0.21.0

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache-2.0
Home: https://pypi.org/project/tokenizers/
Development: https://github.com/huggingface/tokenizers
12 total downloads
Last upload: 7 months and 1 day ago

Installers

linux-64 v0.21.0

conda install

To install this package run one of the following:
conda install services-build-deps::tokenizers

Description

© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2) Legal | Privacy Policy