tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/tokenizers-0.10.3-py39h837c7e6_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Feb 21, 2024, 07:15 AM | 3.15 MB | 2 | |
linux-ppc64le/tokenizers-0.10.3-py39h4ba5e45_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Feb 21, 2024, 07:15 AM | 3.15 MB | 2 | |
linux-ppc64le/tokenizers-0.10.3-py37h837c7e6_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Feb 21, 2024, 07:15 AM | 3.15 MB | 2 | |
linux-ppc64le/tokenizers-0.10.3-py37h4ba5e45_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Feb 21, 2024, 07:15 AM | 3.15 MB | 2 |