tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
osx-64/tokenizers-0.22.2-py310h813fcaf_0.conda | conda | 0.22.2 | osx-64 | main | 18 days ago | 2.19 MB | 88 | |
osx-arm64/tokenizers-0.22.2-py313h4bd1e59_0.conda | conda | 0.22.2 | osx-arm64 | main | 18 days ago | 2.1 MB | 273 | |
osx-64/tokenizers-0.22.2-py311h98b24dd_0.conda | conda | 0.22.2 | osx-64 | main | 18 days ago | 2.21 MB | 113 | |
osx-64/tokenizers-0.22.2-py313h185603f_0.conda | conda | 0.22.2 | osx-64 | main | 18 days ago | 2.2 MB | 77 | |
osx-arm64/tokenizers-0.22.2-py314h84b920e_0.conda | conda | 0.22.2 | osx-arm64 | main | 18 days ago | 2.1 MB | 238 | |
linux-aarch64/tokenizers-0.22.2-py311hff221b2_0.conda | conda | 0.22.2 | linux-aarch64 | main | 18 days ago | 2.32 MB | 71 | |
linux-aarch64/tokenizers-0.22.2-py310h6a2b25b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 18 days ago | 2.32 MB | 202 | |
osx-arm64/tokenizers-0.22.2-py310h8c671df_0.conda | conda | 0.22.2 | osx-arm64 | main | 18 days ago | 2.1 MB | 236 | |
osx-64/tokenizers-0.22.2-py314h0484ab5_0.conda | conda | 0.22.2 | osx-64 | main | 18 days ago | 2.2 MB | 28 | |
osx-arm64/tokenizers-0.22.2-py311h4175fc0_0.conda | conda | 0.22.2 | osx-arm64 | main | 18 days ago | 2.11 MB | 379 | |
linux-ppc64le/tokenizers-0.22.2-py312h973f3a9_0.conda | conda | 0.22.2 | linux-ppc64le | main | 18 days ago | 2.63 MB | 14 | |
win-64/tokenizers-0.22.2-py310h1657867_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.95 MB | 594 | |
linux-ppc64le/tokenizers-0.22.2-py311h1fa80a4_0.conda | conda | 0.22.2 | linux-ppc64le | main | 18 days ago | 2.63 MB | 20 | |
osx-arm64/tokenizers-0.22.2-py312hab2ecbf_0.conda | conda | 0.22.2 | osx-arm64 | main | 18 days ago | 2.11 MB | 348 | |
linux-ppc64le/tokenizers-0.22.2-py314hbbe27e7_0.conda | conda | 0.22.2 | linux-ppc64le | main | 18 days ago | 2.63 MB | 15 | |
win-64/tokenizers-0.22.2-py311h9468d6e_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.96 MB | 572 | |
win-64/tokenizers-0.22.2-py312h362b069_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.96 MB | 707 | |
osx-64/tokenizers-0.22.2-py312h323b2ae_0.conda | conda | 0.22.2 | osx-64 | main | 18 days ago | 2.2 MB | 105 | |
win-64/tokenizers-0.22.2-py314h8101fc5_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.96 MB | 72 | |
win-64/tokenizers-0.22.2-py313h034fbed_0.conda | conda | 0.22.2 | win-64 | main | 18 days ago | 1.96 MB | 365 | |
linux-aarch64/tokenizers-0.22.2-py314h56f8308_0.conda | conda | 0.22.2 | linux-aarch64 | main | 18 days ago | 2.33 MB | 199 | |
linux-aarch64/tokenizers-0.22.2-py313ha0ae100_0.conda | conda | 0.22.2 | linux-aarch64 | main | 18 days ago | 2.32 MB | 384 | |
linux-aarch64/tokenizers-0.22.2-py312hd75027b_0.conda | conda | 0.22.2 | linux-aarch64 | main | 18 days ago | 2.32 MB | 298 | |
linux-ppc64le/tokenizers-0.22.2-py313h45ed5af_0.conda | conda | 0.22.2 | linux-ppc64le | main | 18 days ago | 2.63 MB | 11 | |
linux-ppc64le/tokenizers-0.22.2-py310he6102e5_0.conda | conda | 0.22.2 | linux-ppc64le | main | 18 days ago | 2.62 MB | 14 |