tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/tokenizers-0.10.3-py39haca8c1d_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Nov 18, 2021, 04:10 PM | 3.08 MB | 4 | |
linux-ppc64le/tokenizers-0.10.3-py38haca8c1d_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Nov 18, 2021, 04:10 PM | 3.08 MB | 3 | |
linux-ppc64le/tokenizers-0.10.3-py37haca8c1d_1.tar.bz2 | conda | 0.10.3 | linux-ppc64le | main | Nov 18, 2021, 04:10 PM | 3.08 MB | 3 | |
osx-64/tokenizers-0.10.3-py39h7bafbf5_1.tar.bz2 | conda | 0.10.3 | osx-64 | main | Nov 18, 2021, 04:09 PM | 2.04 MB | 7 | |
osx-64/tokenizers-0.10.3-py38h7bafbf5_1.tar.bz2 | conda | 0.10.3 | osx-64 | main | Nov 18, 2021, 04:09 PM | 2.04 MB | 6 | |
osx-64/tokenizers-0.10.3-py37h7bafbf5_1.tar.bz2 | conda | 0.10.3 | osx-64 | main | Nov 18, 2021, 04:09 PM | 2.04 MB | 5 | |
linux-aarch64/tokenizers-0.10.3-py39h3c2c533_1.tar.bz2 | conda | 0.10.3 | linux-aarch64 | main | Nov 18, 2021, 04:09 PM | 2.84 MB | 5 | |
linux-aarch64/tokenizers-0.10.3-py38h3c2c533_1.tar.bz2 | conda | 0.10.3 | linux-aarch64 | main | Nov 18, 2021, 04:09 PM | 2.83 MB | 3 | |
linux-aarch64/tokenizers-0.10.3-py37h3c2c533_1.tar.bz2 | conda | 0.10.3 | linux-aarch64 | main | Nov 18, 2021, 04:09 PM | 2.84 MB | 3 | |
linux-64/tokenizers-0.10.3-py39hb317417_1.tar.bz2 | conda | 0.10.3 | linux-64 | main | Nov 18, 2021, 04:09 PM | 2.86 MB | 30 | |
linux-64/tokenizers-0.10.3-py38hb317417_1.tar.bz2 | conda | 0.10.3 | linux-64 | main | Nov 18, 2021, 04:09 PM | 2.86 MB | 10 | |
linux-64/tokenizers-0.10.3-py37hb317417_1.tar.bz2 | conda | 0.10.3 | linux-64 | main | Nov 18, 2021, 04:09 PM | 2.86 MB | 11 | |
osx-arm64/tokenizers-0.10.3-py39ha0c5f46_1.tar.bz2 | conda | 0.10.3 | osx-arm64 | main | Nov 18, 2021, 04:05 PM | 2 MB | 7 | |
osx-arm64/tokenizers-0.10.3-py38ha0c5f46_1.tar.bz2 | conda | 0.10.3 | osx-arm64 | main | Nov 18, 2021, 04:05 PM | 2 MB | 5 |