Tokenizers | Anaconda.org

powerai / packages / tokenizers 0.7.0

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache-2.0
Home: https://github.com/huggingface/tokenizers
Documentation: https://huggingface.co/tokenizers/
2176 total downloads
Last upload: 4 years and 5 months ago

Installers

linux-ppc64le v0.7.0
linux-64 v0.7.0

conda install

To install this package run one of the following:
conda install powerai::tokenizers

Description

© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy