Tokenizers | Anaconda.org

ab-geo / packages / tokenizers 0.21.0

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

License: Apache-2.0
Home: https://pypi.org/project/tokenizers/
Development: https://github.com/huggingface/tokenizers
98 total downloads
Last upload: 2 months and 26 days ago

Installers

win-64 v0.15.0
linux-64 v0.21.0

conda install

To install this package run one of the following:
conda install ab-geo::tokenizers

Description

© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.0) Legal | Privacy Policy