tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
osx-64/tokenizers-0.22.2-py310h813fcaf_0.conda | conda | 0.22.2 | osx-64 | main | 29 days ago | 2.19 MB | 117 | |
osx-arm64/tokenizers-0.22.2-py313h4bd1e59_0.conda | conda | 0.22.2 | osx-arm64 | main | 29 days ago | 2.1 MB | 374 | |
osx-64/tokenizers-0.22.2-py311h98b24dd_0.conda | conda | 0.22.2 | osx-64 | main | 29 days ago | 2.21 MB | 171 | |
osx-64/tokenizers-0.22.2-py313h185603f_0.conda | conda | 0.22.2 | osx-64 | main | 29 days ago | 2.2 MB | 115 | |
osx-arm64/tokenizers-0.22.2-py314h84b920e_0.conda | conda | 0.22.2 | osx-arm64 | main | 29 days ago | 2.1 MB | 347 | |
linux-aarch64/tokenizers-0.22.2-py311hff221b2_0.conda | conda | 0.22.2 | linux-aarch64 | main | 29 days ago | 2.32 MB | 95 | |
linux-aarch64/tokenizers-0.22.2-py310h6a2b25b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 29 days ago | 2.32 MB | 270 | |
osx-arm64/tokenizers-0.22.2-py310h8c671df_0.conda | conda | 0.22.2 | osx-arm64 | main | 29 days ago | 2.1 MB | 345 | |
osx-64/tokenizers-0.22.2-py314h0484ab5_0.conda | conda | 0.22.2 | osx-64 | main | 29 days ago | 2.2 MB | 35 | |
osx-arm64/tokenizers-0.22.2-py311h4175fc0_0.conda | conda | 0.22.2 | osx-arm64 | main | 29 days ago | 2.11 MB | 556 | |
linux-ppc64le/tokenizers-0.22.2-py312h973f3a9_0.conda | conda | 0.22.2 | linux-ppc64le | main | 29 days ago | 2.63 MB | 19 | |
win-64/tokenizers-0.22.2-py310h1657867_0.conda | conda | 0.22.2 | win-64 | main | 29 days ago | 1.95 MB | 871 | |
linux-ppc64le/tokenizers-0.22.2-py311h1fa80a4_0.conda | conda | 0.22.2 | linux-ppc64le | main | 29 days ago | 2.63 MB | 25 | |
osx-arm64/tokenizers-0.22.2-py312hab2ecbf_0.conda | conda | 0.22.2 | osx-arm64 | main | 29 days ago | 2.11 MB | 471 | |
linux-ppc64le/tokenizers-0.22.2-py314hbbe27e7_0.conda | conda | 0.22.2 | linux-ppc64le | main | 29 days ago | 2.63 MB | 19 | |
win-64/tokenizers-0.22.2-py311h9468d6e_0.conda | conda | 0.22.2 | win-64 | main | 29 days ago | 1.96 MB | 874 | |
win-64/tokenizers-0.22.2-py312h362b069_0.conda | conda | 0.22.2 | win-64 | main | 29 days ago | 1.96 MB | 944 | |
osx-64/tokenizers-0.22.2-py312h323b2ae_0.conda | conda | 0.22.2 | osx-64 | main | 29 days ago | 2.2 MB | 149 | |
win-64/tokenizers-0.22.2-py314h8101fc5_0.conda | conda | 0.22.2 | win-64 | main | 29 days ago | 1.96 MB | 107 | |
win-64/tokenizers-0.22.2-py313h034fbed_0.conda | conda | 0.22.2 | win-64 | main | 29 days ago | 1.96 MB | 523 | |
linux-aarch64/tokenizers-0.22.2-py314h56f8308_0.conda | conda | 0.22.2 | linux-aarch64 | main | 29 days ago | 2.33 MB | 259 | |
linux-aarch64/tokenizers-0.22.2-py313ha0ae100_0.conda | conda | 0.22.2 | linux-aarch64 | main | 29 days ago | 2.32 MB | 539 | |
linux-aarch64/tokenizers-0.22.2-py312hd75027b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 29 days ago | 2.32 MB | 378 | |
linux-ppc64le/tokenizers-0.22.2-py313h45ed5af_0.conda | conda | 0.22.2 | linux-ppc64le | main | 29 days ago | 2.63 MB | 14 | |
linux-ppc64le/tokenizers-0.22.2-py310he6102e5_0.conda | conda | 0.22.2 | linux-ppc64le | main | 29 days ago | 2.62 MB | 18 |