tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
osx-64/tokenizers-0.22.2-py310h813fcaf_0.conda | conda | 0.22.2 | osx-64 | main | 27 days ago | 2.19 MB | 113 | |
osx-arm64/tokenizers-0.22.2-py313h4bd1e59_0.conda | conda | 0.22.2 | osx-arm64 | main | 27 days ago | 2.1 MB | 353 | |
osx-64/tokenizers-0.22.2-py311h98b24dd_0.conda | conda | 0.22.2 | osx-64 | main | 27 days ago | 2.21 MB | 165 | |
osx-64/tokenizers-0.22.2-py313h185603f_0.conda | conda | 0.22.2 | osx-64 | main | 27 days ago | 2.2 MB | 113 | |
osx-arm64/tokenizers-0.22.2-py314h84b920e_0.conda | conda | 0.22.2 | osx-arm64 | main | 27 days ago | 2.1 MB | 328 | |
linux-aarch64/tokenizers-0.22.2-py311hff221b2_0.conda | conda | 0.22.2 | linux-aarch64 | main | 27 days ago | 2.32 MB | 92 | |
linux-aarch64/tokenizers-0.22.2-py310h6a2b25b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 27 days ago | 2.32 MB | 260 | |
osx-arm64/tokenizers-0.22.2-py310h8c671df_0.conda | conda | 0.22.2 | osx-arm64 | main | 27 days ago | 2.1 MB | 322 | |
osx-64/tokenizers-0.22.2-py314h0484ab5_0.conda | conda | 0.22.2 | osx-64 | main | 27 days ago | 2.2 MB | 34 | |
osx-arm64/tokenizers-0.22.2-py311h4175fc0_0.conda | conda | 0.22.2 | osx-arm64 | main | 27 days ago | 2.11 MB | 515 | |
linux-ppc64le/tokenizers-0.22.2-py312h973f3a9_0.conda | conda | 0.22.2 | linux-ppc64le | main | 27 days ago | 2.63 MB | 19 | |
win-64/tokenizers-0.22.2-py310h1657867_0.conda | conda | 0.22.2 | win-64 | main | 27 days ago | 1.95 MB | 827 | |
linux-ppc64le/tokenizers-0.22.2-py311h1fa80a4_0.conda | conda | 0.22.2 | linux-ppc64le | main | 27 days ago | 2.63 MB | 25 | |
osx-arm64/tokenizers-0.22.2-py312hab2ecbf_0.conda | conda | 0.22.2 | osx-arm64 | main | 27 days ago | 2.11 MB | 443 | |
linux-ppc64le/tokenizers-0.22.2-py314hbbe27e7_0.conda | conda | 0.22.2 | linux-ppc64le | main | 27 days ago | 2.63 MB | 19 | |
win-64/tokenizers-0.22.2-py311h9468d6e_0.conda | conda | 0.22.2 | win-64 | main | 27 days ago | 1.96 MB | 813 | |
win-64/tokenizers-0.22.2-py312h362b069_0.conda | conda | 0.22.2 | win-64 | main | 27 days ago | 1.96 MB | 914 | |
osx-64/tokenizers-0.22.2-py312h323b2ae_0.conda | conda | 0.22.2 | osx-64 | main | 27 days ago | 2.2 MB | 143 | |
win-64/tokenizers-0.22.2-py314h8101fc5_0.conda | conda | 0.22.2 | win-64 | main | 27 days ago | 1.96 MB | 101 | |
win-64/tokenizers-0.22.2-py313h034fbed_0.conda | conda | 0.22.2 | win-64 | main | 27 days ago | 1.96 MB | 501 | |
linux-aarch64/tokenizers-0.22.2-py314h56f8308_0.conda | conda | 0.22.2 | linux-aarch64 | main | 27 days ago | 2.33 MB | 251 | |
linux-aarch64/tokenizers-0.22.2-py313ha0ae100_0.conda | conda | 0.22.2 | linux-aarch64 | main | 27 days ago | 2.32 MB | 513 | |
linux-aarch64/tokenizers-0.22.2-py312hd75027b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 27 days ago | 2.32 MB | 369 | |
linux-ppc64le/tokenizers-0.22.2-py313h45ed5af_0.conda | conda | 0.22.2 | linux-ppc64le | main | 27 days ago | 2.63 MB | 14 | |
linux-ppc64le/tokenizers-0.22.2-py310he6102e5_0.conda | conda | 0.22.2 | linux-ppc64le | main | 27 days ago | 2.62 MB | 18 |