Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.13.1
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py310h2790ac9_2.tar.bz2
2 years and 10 months ago
951
main
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py311h91c4a10_2.tar.bz2
2 years and 10 months ago
196
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py38hf11c49c_2.tar.bz2
2 years and 10 months ago
622
main
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py38h9a9026f_2.tar.bz2
2 years and 10 months ago
523
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py311h6d2de94_2.tar.bz2
2 years and 10 months ago
198
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py39h6120d9b_2.tar.bz2
2 years and 10 months ago
1934
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py39h84cb38f_2.tar.bz2
2 years and 10 months ago
1466
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py310he8402e3_2.tar.bz2
2 years and 10 months ago
4265
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py310hdfc2a09_2.tar.bz2
2 years and 10 months ago
2265
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py38hc426687_2.tar.bz2
2 years and 10 months ago
366
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py311h572acbd_2.tar.bz2
2 years and 10 months ago
253
main
conda
2.9 MB
|
win-64/tokenizers-0.13.1-py39hca44cb7_2.tar.bz2
2 years and 10 months ago
1283
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py311hec8975b_2.tar.bz2
2 years and 10 months ago
46
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.13.1-py38hc635be6_2.tar.bz2
2 years and 10 months ago
43
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py39h13bea7b_2.tar.bz2
2 years and 10 months ago
45
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py310h633acb5_2.tar.bz2
2 years and 10 months ago
27431
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py38h8bed557_2.tar.bz2
2 years and 10 months ago
10137
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py310hf3e0ef4_2.tar.bz2
2 years and 10 months ago
46
main
conda
4.5 MB
|
linux-aarch64/tokenizers-0.13.1-py39h509f947_2.tar.bz2
2 years and 10 months ago
184
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py310h26665ef_2.tar.bz2
2 years and 10 months ago
130
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py311h7f5e267_2.tar.bz2
2 years and 10 months ago
72
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py38h2e5b999_2.tar.bz2
2 years and 10 months ago
96
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py39h4d2953e_2.tar.bz2
2 years and 10 months ago
15385
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py311h0ecb24d_2.tar.bz2
2 years and 10 months ago
2658
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py311h5aa5048_2.tar.bz2
2 years and 10 months ago
43
main
« Previous
showing 0 of 4
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
