tokenizers

Community

Fast State-of-the-Art Tokenizers optimized for Research and Production

Versions

To install this package, run one of the following:

$conda install tacc::tokenizers

Version

1 / 8 versions selected

Downloads (Last 6 months): 0

Summary

Fast State-of-the-Art Tokenizers optimized for Research and Production

Last Updated

Sep 30, 2020 at 15:36

License

Apache License 2.0

Supported Platforms

linux-ppc64le

Home

Documentation