Tokenizers | Anaconda.org

AlphaPower10_0ead / packages / tokenizers 0.10.3

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache-2.0
Home: https://github.com/huggingface/tokenizers
Documentation: https://huggingface.co/tokenizers/
8 total downloads
Last upload: 1 year and 6 months ago

Installers

linux-ppc64le v0.10.3

conda install

To install this package run one of the following:
conda install alphapower10_0ead::tokenizers

Description

Fast State-of-the-Art Tokenizers optimized for Research and Production

© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.1) Legal | Privacy Policy