tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/tokenizers-0.15.2-opence_py311_hb3c3cb4_0.conda | conda | 0.15.2 | linux-ppc64le | rocketce-1.11.6 | May 19, 2025, 12:00 PM | 2.09 MB | 1 |