tokenizers
Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-64/tokenizers-0.10.3-py310hb317417_1.conda | conda | 0.10.3 | linux-64 | main | Apr 1, 2025, 12:32 AM | 2.39 MB | 1 | |
linux-64/tokenizers-0.11.4-py310h3dcd8bd_1.conda | conda | 0.11.4 | linux-64 | main | Apr 1, 2025, 12:32 AM | 3.63 MB | 1 | |
linux-64/tokenizers-0.13.2-py311he7d60b5_1.conda | conda | 0.13.2 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.15 MB | 1 | |
linux-64/tokenizers-0.13.2-py311he7d60b5_0.conda | conda | 0.13.2 | linux-64 | main | Apr 1, 2025, 12:32 AM | 3.6 MB | 1 | |
linux-64/tokenizers-0.13.2-py311h22610ee_1.conda | conda | 0.13.2 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.15 MB | 1 | |
linux-64/tokenizers-0.13.2-py310he7d60b5_1.conda | conda | 0.13.2 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.14 MB | 1 | |
linux-64/tokenizers-0.13.2-py310h22610ee_1.conda | conda | 0.13.2 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.14 MB | 1 | |
linux-64/tokenizers-0.13.3-py312h22610ee_0.conda | conda | 0.13.3 | linux-64 | main | Apr 1, 2025, 12:32 AM | 3.96 MB | 1 | |
linux-64/tokenizers-0.13.3-py311h22610ee_0.conda | conda | 0.13.3 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.43 MB | 1 | |
linux-64/tokenizers-0.13.3-py310h22610ee_0.conda | conda | 0.13.3 | linux-64 | main | Apr 1, 2025, 12:32 AM | 4.42 MB | 1 | |
linux-64/tokenizers-0.15.1-py312h22610ee_0.conda | conda | 0.15.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 2.52 MB | 1 | |
linux-64/tokenizers-0.15.1-py311h22610ee_0.conda | conda | 0.15.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 3.01 MB | 1 | |
linux-64/tokenizers-0.15.1-py310h22610ee_0.conda | conda | 0.15.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 3 MB | 1 | |
linux-64/tokenizers-0.19.1-py312ha11519a_0.conda | conda | 0.19.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 2.83 MB | 1 | |
linux-64/tokenizers-0.19.1-py311h585d796_0.conda | conda | 0.19.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 2.83 MB | 1 | |
linux-64/tokenizers-0.19.1-py310hff361bb_0.conda | conda | 0.19.1 | linux-64 | main | Apr 1, 2025, 12:32 AM | 2.82 MB | 1 | |
linux-64/tokenizers-0.20.1-py312h526025d_1.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.31 MB | 1 | |
linux-64/tokenizers-0.20.1-py312h28f53f8_0.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.95 MB | 1 | |
linux-64/tokenizers-0.20.1-py311h766900b_0.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.95 MB | 1 | |
linux-64/tokenizers-0.20.1-py311h5e3497e_1.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.32 MB | 1 | |
linux-64/tokenizers-0.20.1-py310ha92566c_1.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.31 MB | 1 | |
linux-64/tokenizers-0.20.1-py310h7d74088_0.conda | conda | 0.20.1 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.94 MB | 1 | |
linux-64/tokenizers-0.21.0-py312h526025d_0.conda | conda | 0.21.0 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.32 MB | 1 | |
linux-64/tokenizers-0.21.0-py311h5e3497e_0.conda | conda | 0.21.0 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.32 MB | 1 | |
linux-64/tokenizers-0.21.0-py310ha92566c_0.conda | conda | 0.21.0 | linux-64 | main | Apr 1, 2025, 12:31 AM | 2.31 MB | 1 |