Manage | Anaconda.org

tacc / packages / tokenizers 0.8.1

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache License 2.0
Home: https://github.com/huggingface/tokenizers
Documentation: https://huggingface.co/tokenizers/
9 total downloads
Last upload: 5 years and 6 months ago

Installers

linux-ppc64le v0.8.1

conda install

To install this package run one of the following:
conda install tacc::tokenizers

Description

© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.15) Legal | Privacy Policy