tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/tokenizers-0.15.2-opence_py311_hb3c3cb4_0.conda | conda | 0.15.2 | linux-ppc64le | rocketce-1.11.5mainrocketce-1.11.6 | Mar 7, 2025, 06:56 PM | 2.08 MB | 184 | |
linux-ppc64le/tokenizers-0.15.2-opence_py310_hb3c3cb4_0.conda | conda | 0.15.2 | linux-ppc64le | rocketce-1.11.5mainrocketce-1.11.6 | Mar 7, 2025, 06:56 PM | 2.08 MB | 69 | |
linux-ppc64le/tokenizers-0.15.2-opence_py311_h43e99ca_0.conda | conda | 0.15.2 | linux-ppc64le | rocketce-1.11.2main | Jul 12, 2024, 11:24 AM | 2.1 MB | 109 | |
linux-ppc64le/tokenizers-0.15.2-opence_py310_h43e99ca_0.conda | conda | 0.15.2 | linux-ppc64le | rocketce-1.11.2main | Jul 12, 2024, 11:24 AM | 2.09 MB | 109 | |
linux-ppc64le/tokenizers-0.13.3-opence_py39_hc02ed0c_0.conda | conda | 0.13.3 | linux-ppc64le | rocketce-1.10.0main | Dec 18, 2023, 04:27 PM | 4.6 MB | 41 | |
linux-ppc64le/tokenizers-0.13.3-opence_py311_hc02ed0c_0.conda | conda | 0.13.3 | linux-ppc64le | rocketce-1.10.0main | Dec 18, 2023, 04:27 PM | 4.6 MB | 104 | |
linux-ppc64le/tokenizers-0.13.3-opence_py310_hc02ed0c_0.conda | conda | 0.13.3 | linux-ppc64le | rocketce-1.10.0main | Dec 18, 2023, 04:27 PM | 4.6 MB | 57 |