tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
osx-64/tokenizers-0.22.2-py310h813fcaf_0.conda | conda | 0.22.2 | osx-64 | main | 26 days ago | 2.19 MB | 110 | |
osx-arm64/tokenizers-0.22.2-py313h4bd1e59_0.conda | conda | 0.22.2 | osx-arm64 | main | 26 days ago | 2.1 MB | 341 | |
osx-64/tokenizers-0.22.2-py311h98b24dd_0.conda | conda | 0.22.2 | osx-64 | main | 26 days ago | 2.21 MB | 152 | |
osx-64/tokenizers-0.22.2-py313h185603f_0.conda | conda | 0.22.2 | osx-64 | main | 26 days ago | 2.2 MB | 106 | |
osx-arm64/tokenizers-0.22.2-py314h84b920e_0.conda | conda | 0.22.2 | osx-arm64 | main | 26 days ago | 2.1 MB | 317 | |
linux-aarch64/tokenizers-0.22.2-py311hff221b2_0.conda | conda | 0.22.2 | linux-aarch64 | main | 26 days ago | 2.32 MB | 88 | |
linux-aarch64/tokenizers-0.22.2-py310h6a2b25b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 26 days ago | 2.32 MB | 246 | |
osx-arm64/tokenizers-0.22.2-py310h8c671df_0.conda | conda | 0.22.2 | osx-arm64 | main | 26 days ago | 2.1 MB | 306 | |
osx-64/tokenizers-0.22.2-py314h0484ab5_0.conda | conda | 0.22.2 | osx-64 | main | 26 days ago | 2.2 MB | 33 | |
osx-arm64/tokenizers-0.22.2-py311h4175fc0_0.conda | conda | 0.22.2 | osx-arm64 | main | 26 days ago | 2.11 MB | 489 | |
linux-ppc64le/tokenizers-0.22.2-py312h973f3a9_0.conda | conda | 0.22.2 | linux-ppc64le | main | 26 days ago | 2.63 MB | 18 | |
win-64/tokenizers-0.22.2-py310h1657867_0.conda | conda | 0.22.2 | win-64 | main | 26 days ago | 1.95 MB | 806 | |
linux-ppc64le/tokenizers-0.22.2-py311h1fa80a4_0.conda | conda | 0.22.2 | linux-ppc64le | main | 26 days ago | 2.63 MB | 23 | |
osx-arm64/tokenizers-0.22.2-py312hab2ecbf_0.conda | conda | 0.22.2 | osx-arm64 | main | 26 days ago | 2.11 MB | 429 | |
linux-ppc64le/tokenizers-0.22.2-py314hbbe27e7_0.conda | conda | 0.22.2 | linux-ppc64le | main | 26 days ago | 2.63 MB | 17 | |
win-64/tokenizers-0.22.2-py311h9468d6e_0.conda | conda | 0.22.2 | win-64 | main | 26 days ago | 1.96 MB | 778 | |
win-64/tokenizers-0.22.2-py312h362b069_0.conda | conda | 0.22.2 | win-64 | main | 26 days ago | 1.96 MB | 885 | |
osx-64/tokenizers-0.22.2-py312h323b2ae_0.conda | conda | 0.22.2 | osx-64 | main | 26 days ago | 2.2 MB | 133 | |
win-64/tokenizers-0.22.2-py314h8101fc5_0.conda | conda | 0.22.2 | win-64 | main | 26 days ago | 1.96 MB | 93 | |
win-64/tokenizers-0.22.2-py313h034fbed_0.conda | conda | 0.22.2 | win-64 | main | 26 days ago | 1.96 MB | 484 | |
linux-aarch64/tokenizers-0.22.2-py314h56f8308_0.conda | conda | 0.22.2 | linux-aarch64 | main | 26 days ago | 2.33 MB | 245 | |
linux-aarch64/tokenizers-0.22.2-py313ha0ae100_0.conda | conda | 0.22.2 | linux-aarch64 | main | 26 days ago | 2.32 MB | 494 | |
linux-aarch64/tokenizers-0.22.2-py312hd75027b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 26 days ago | 2.32 MB | 359 | |
linux-ppc64le/tokenizers-0.22.2-py313h45ed5af_0.conda | conda | 0.22.2 | linux-ppc64le | main | 26 days ago | 2.63 MB | 13 | |
linux-ppc64le/tokenizers-0.22.2-py310he6102e5_0.conda | conda | 0.22.2 | linux-ppc64le | main | 26 days ago | 2.62 MB | 16 |