Tokenizers | Anaconda.org

fastchan / packages / tokenizers 0.13.3

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from huggingface / tokenizers

License: Apache-2.0
Home: https://pypi.org/project/tokenizers/
Development: https://github.com/huggingface/tokenizers
168236 total downloads
Last upload: 1 year and 7 months ago

Installers

linux-64 v0.13.3
osx-64 v0.13.3
win-64 v0.13.3
linux-aarch64 v0.13.3
linux-ppc64le v0.13.3
osx-arm64 v0.13.3

conda install

To install this package run one of the following:
conda install fastchan::tokenizers

Description

© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.5) Legal | Privacy Policy