tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Actions |
|---|
win-64/tokenizers-0.22.2-py314_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.93 MB | |
win-64/tokenizers-0.22.2-py312_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.94 MB | |
win-64/tokenizers-0.22.2-py311_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.95 MB | |
win-64/tokenizers-0.22.2-py313_0.conda | conda | 0.22.2 | win-64 | main | 19 days ago | 1.94 MB | |
linux-64/tokenizers-0.22.2-py314_0.conda | conda | 0.22.2 | linux-64 | main | 19 days ago | 2.31 MB | |
linux-64/tokenizers-0.22.2-py311_0.conda | conda | 0.22.2 | linux-64 | main | 19 days ago | 2.33 MB | |
linux-64/tokenizers-0.22.2-py312_0.conda | conda | 0.22.2 | linux-64 | main | 19 days ago | 2.33 MB | |
linux-64/tokenizers-0.22.2-py313_0.conda | conda | 0.22.2 | linux-64 | main | 19 days ago | 2.33 MB |