tokenizers

Anaconda Verified

Fast State-of-the-Art Tokenizers optimized for Research and Production

win-64/tokenizers-0.23.1-py314hfcf8c06_0.tar.bz2

conda

0.23.1

win-64

main

19 days ago

2.45 MB

win-64/tokenizers-0.23.1-py313h9f3fdb6_0.tar.bz2

conda

0.23.1

win-64

main

19 days ago

2.45 MB

win-64/tokenizers-0.23.1-py312h9f3fdb6_0.tar.bz2

conda

0.23.1

win-64

main

19 days ago

2.46 MB

win-64/tokenizers-0.23.1-py311h9f3fdb6_0.tar.bz2

conda

0.23.1

win-64

main

19 days ago

2.47 MB

win-64/tokenizers-0.23.1-py310h9f3fdb6_0.tar.bz2

conda

0.23.1

win-64

main

19 days ago

2.47 MB

osx-arm64/tokenizers-0.23.1-py313h5dd1ca5_0.tar.bz2

conda

0.23.1

macOS-arm64

main

19 days ago

2.6 MB

osx-arm64/tokenizers-0.23.1-py314hb450910_0.tar.bz2

conda

0.23.1

macOS-arm64

main

19 days ago

2.58 MB

osx-arm64/tokenizers-0.23.1-py312h5dd1ca5_0.tar.bz2

conda

0.23.1

macOS-arm64

main

19 days ago

2.6 MB

osx-arm64/tokenizers-0.23.1-py311h5dd1ca5_0.tar.bz2

conda

0.23.1

macOS-arm64

main

19 days ago

2.58 MB

osx-arm64/tokenizers-0.23.1-py310h5dd1ca5_0.tar.bz2

conda

0.23.1

macOS-arm64

main

19 days ago

2.57 MB

linux-aarch64/tokenizers-0.23.1-py314he4be11e_0.tar.bz2

conda

0.23.1

linux-aarch64

main

19 days ago

2.85 MB

linux-aarch64/tokenizers-0.23.1-py313he80eeee_0.tar.bz2

conda

0.23.1

linux-aarch64

main

19 days ago

2.84 MB

linux-aarch64/tokenizers-0.23.1-py312he80eeee_0.tar.bz2

conda

0.23.1

linux-aarch64

main

19 days ago

2.84 MB

linux-aarch64/tokenizers-0.23.1-py311he80eeee_0.tar.bz2

conda

0.23.1

linux-aarch64

main

19 days ago

2.83 MB

linux-aarch64/tokenizers-0.23.1-py310he80eeee_0.tar.bz2

conda

0.23.1

linux-aarch64

main

19 days ago

2.83 MB

linux-64/tokenizers-0.23.1-py314h27d2130_0.tar.bz2

conda

0.23.1

linux-64

main

19 days ago

2.89 MB

linux-64/tokenizers-0.23.1-py313hac4c11a_0.tar.bz2

conda

0.23.1

linux-64

main

19 days ago

2.89 MB

linux-64/tokenizers-0.23.1-py312hac4c11a_0.tar.bz2

conda

0.23.1

linux-64

main

19 days ago

2.9 MB

linux-64/tokenizers-0.23.1-py311hac4c11a_0.tar.bz2

conda

0.23.1

linux-64

main

19 days ago

2.9 MB

linux-64/tokenizers-0.23.1-py310hac4c11a_0.tar.bz2

conda

0.23.1

linux-64

main

19 days ago

2.86 MB

linux-64/tokenizers-0.22.2-py314h27d2130_1.tar.bz2

conda

0.22.2

linux-64

main

Mar 17, 2026, 09:58 PM

2.8 MB

linux-64/tokenizers-0.22.2-py313hac4c11a_1.tar.bz2

conda

0.22.2

linux-64

main

Mar 17, 2026, 09:58 PM

2.8 MB

linux-64/tokenizers-0.22.2-py311hac4c11a_1.tar.bz2

conda

0.22.2

linux-64

main

Mar 17, 2026, 09:58 PM

2.81 MB

linux-64/tokenizers-0.22.2-py312hac4c11a_1.tar.bz2

conda

0.22.2

linux-64

main

Mar 17, 2026, 09:58 PM

2.8 MB

linux-64/tokenizers-0.22.2-py310hac4c11a_1.tar.bz2

conda

0.22.2

linux-64

main

Mar 17, 2026, 09:58 PM

2.82 MB

Filters