tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-64/tokenizers-0.11.4-py310h3dcd8bd_1.conda | conda | 0.11.4 | linux-64 | main | May 26, 2023, 08:13 PM | 3.63 MB | 3 |