Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
HuggingFace
/
packages
/
tokenizers
1
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.12.1
All
0.13.2
0.13.1
0.13.0
0.13.0.dev0
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.10.3
0.10.2
0.10.1
0.10.1rc1
0.10.0
0.10.0rc1
0.9.4
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
3.2 MB
|
osx-64/tokenizers-0.12.1-py38_0.tar.bz2
3 years and 5 months ago
180
main
conda
3.2 MB
|
osx-64/tokenizers-0.12.1-py39_0.tar.bz2
3 years and 5 months ago
638
main
conda
3.0 MB
|
win-64/tokenizers-0.12.1-py37_0.tar.bz2
3 years and 5 months ago
272
main
conda
3.0 MB
|
win-64/tokenizers-0.12.1-py39_0.tar.bz2
3 years and 5 months ago
1521
main
conda
3.0 MB
|
win-64/tokenizers-0.12.1-py38_0.tar.bz2
3 years and 5 months ago
486
main
conda
3.2 MB
|
osx-64/tokenizers-0.12.1-py37_0.tar.bz2
3 years and 5 months ago
112
main
conda
4.3 MB
|
linux-64/tokenizers-0.12.1-py39_0.tar.bz2
3 years and 5 months ago
2210
main
conda
4.3 MB
|
linux-64/tokenizers-0.12.1-py38_0.tar.bz2
3 years and 5 months ago
1697
main
conda
4.3 MB
|
linux-64/tokenizers-0.12.1-py37_0.tar.bz2
3 years and 5 months ago
685
main
« Previous
showing 0 of 1
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
