tokenizers

Community

Fast State-of-the-Art Tokenizers optimized for Research and Production

Copied fromcf-post-staging / tokenizers

osx-64/tokenizers-0.22.2-py310h813fcaf_0.conda

conda

0.22.2

osx-64

main

Dec 2, 2025, 05:24 PM

2.19 MB

123

osx-arm64/tokenizers-0.22.2-py313h4bd1e59_0.conda

conda

0.22.2

osx-arm64

main

Dec 2, 2025, 05:21 PM

2.1 MB

385

osx-64/tokenizers-0.22.2-py311h98b24dd_0.conda

conda

0.22.2

osx-64

main

Dec 2, 2025, 05:20 PM

2.21 MB

173

osx-64/tokenizers-0.22.2-py313h185603f_0.conda

conda

0.22.2

osx-64

main

Dec 2, 2025, 05:19 PM

2.2 MB

119

osx-arm64/tokenizers-0.22.2-py314h84b920e_0.conda

conda

0.22.2

osx-arm64

main

Dec 2, 2025, 05:18 PM

2.1 MB

367

linux-aarch64/tokenizers-0.22.2-py311hff221b2_0.conda

conda

0.22.2

linux-aarch64

main

Dec 2, 2025, 05:18 PM

2.32 MB

linux-aarch64/tokenizers-0.22.2-py310h6a2b25b_0.conda

conda

0.22.2

linux-aarch64

main

Dec 2, 2025, 05:16 PM

2.32 MB

278

osx-arm64/tokenizers-0.22.2-py310h8c671df_0.conda

conda

0.22.2

osx-arm64

main

Dec 2, 2025, 05:16 PM

2.1 MB

357

osx-64/tokenizers-0.22.2-py314h0484ab5_0.conda

conda

0.22.2

osx-64

main

Dec 2, 2025, 05:16 PM

2.2 MB

osx-arm64/tokenizers-0.22.2-py311h4175fc0_0.conda

conda

0.22.2

osx-arm64

main

Dec 2, 2025, 05:16 PM

2.11 MB

570

linux-ppc64le/tokenizers-0.22.2-py312h973f3a9_0.conda

conda

0.22.2

linux-ppc64le

main

Dec 2, 2025, 05:15 PM

2.63 MB

win-64/tokenizers-0.22.2-py310h1657867_0.conda

conda

0.22.2

win-64

main

Dec 2, 2025, 05:15 PM

1.95 MB

883

linux-ppc64le/tokenizers-0.22.2-py311h1fa80a4_0.conda

conda

0.22.2

linux-ppc64le

main

Dec 2, 2025, 05:15 PM

2.63 MB

osx-arm64/tokenizers-0.22.2-py312hab2ecbf_0.conda

conda

0.22.2

osx-arm64

main

Dec 2, 2025, 05:13 PM

2.11 MB

480

linux-ppc64le/tokenizers-0.22.2-py314hbbe27e7_0.conda

conda

0.22.2

linux-ppc64le

main

Dec 2, 2025, 05:13 PM

2.63 MB

win-64/tokenizers-0.22.2-py311h9468d6e_0.conda

conda

0.22.2

win-64

main

Dec 2, 2025, 05:13 PM

1.96 MB

897

win-64/tokenizers-0.22.2-py312h362b069_0.conda

conda

0.22.2

win-64

main

Dec 2, 2025, 05:12 PM

1.96 MB

958

osx-64/tokenizers-0.22.2-py312h323b2ae_0.conda

conda

0.22.2

osx-64

main

Dec 2, 2025, 05:12 PM

2.2 MB

154

win-64/tokenizers-0.22.2-py314h8101fc5_0.conda

conda

0.22.2

win-64

main

Dec 2, 2025, 05:12 PM

1.96 MB

110

win-64/tokenizers-0.22.2-py313h034fbed_0.conda

conda

0.22.2

win-64

main

Dec 2, 2025, 05:12 PM

1.96 MB

532

linux-aarch64/tokenizers-0.22.2-py314h56f8308_0.conda

conda

0.22.2

linux-aarch64

main

Dec 2, 2025, 05:12 PM

2.33 MB

276

linux-aarch64/tokenizers-0.22.2-py313ha0ae100_0.conda

conda

0.22.2

linux-aarch64

main

Dec 2, 2025, 05:11 PM

2.32 MB

555

linux-aarch64/tokenizers-0.22.2-py312hd75027b_0.conda

conda

0.22.2

linux-aarch64

main

Dec 2, 2025, 05:11 PM

2.32 MB

389

linux-ppc64le/tokenizers-0.22.2-py313h45ed5af_0.conda

conda

0.22.2

linux-ppc64le

main

Dec 2, 2025, 05:10 PM

2.63 MB

linux-ppc64le/tokenizers-0.22.2-py310he6102e5_0.conda

conda

0.22.2

linux-ppc64le

main

Dec 2, 2025, 05:10 PM

2.62 MB

Filters