Tokenizers | Anaconda.org

HuggingFace / packages / tokenizers 0.13.2

1

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache License 2.0
Home: https://huggingface.co/docs/tokenizers
418162 total downloads
Last upload: 1 year and 10 months ago

Installers

linux-64 v0.13.2
osx-64 v0.13.2
win-64 v0.13.2

conda install

To install this package run one of the following:
conda install huggingface::tokenizers

Description

© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.5) Legal | Privacy Policy