Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
A new user experience is coming soon! These rolling changes are ongoing and some pages will still have the old user interface.
HuggingFace
/
packages
/
tokenizers
1
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: conda
All
conda
Version: All
All
0.13.2
0.13.1
0.13.0
0.13.0.dev0
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.10.3
0.10.2
0.10.1
0.10.1rc1
0.10.0
0.10.0rc1
0.9.4
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
2.8 MB
|
linux-64/tokenizers-0.10.1rc1-py35_0.tar.bz2
5 years and 8 days ago
24
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.1rc1-py36_0.tar.bz2
5 years and 8 days ago
8
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.1rc1-py37_0.tar.bz2
5 years and 8 days ago
24
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.1rc1-py36_0.tar.bz2
5 years and 8 days ago
22
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.1rc1-py38_0.tar.bz2
5 years and 8 days ago
20
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0-py38_0.tar.bz2
5 years and 1 month ago
49
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0-py37_0.tar.bz2
5 years and 1 month ago
31
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0-py36_0.tar.bz2
5 years and 1 month ago
27
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0-py35_0.tar.bz2
5 years and 1 month ago
24
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.0-py35_0.tar.bz2
5 years and 1 month ago
26
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.0-py35_0.tar.bz2
5 years and 1 month ago
9
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0rc1-py36_0.tar.bz2
5 years and 2 months ago
20
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0rc1-py37_0.tar.bz2
5 years and 2 months ago
25
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.0rc1-py37_0.tar.bz2
5 years and 2 months ago
11
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0rc1-py38_0.tar.bz2
5 years and 2 months ago
27
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.0rc1-py38_0.tar.bz2
5 years and 2 months ago
11
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.0rc1-py35_0.tar.bz2
5 years and 2 months ago
8
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.0rc1-py36_0.tar.bz2
5 years and 2 months ago
9
main
conda
1.9 MB
|
win-64/tokenizers-0.10.0rc1-py35_0.tar.bz2
5 years and 2 months ago
20
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.0rc1-py35_0.tar.bz2
5 years and 2 months ago
21
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.0rc1-py37_0.tar.bz2
5 years and 2 months ago
66
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.0rc1-py38_0.tar.bz2
5 years and 2 months ago
42
main
conda
2.8 MB
|
linux-64/tokenizers-0.10.0rc1-py36_0.tar.bz2
5 years and 2 months ago
23
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py36_0.tar.bz2
5 years and 2 months ago
844
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py38_0.tar.bz2
5 years and 2 months ago
912
main
« Previous
showing 6 of 7
Next »
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.14)
Legal
|
Privacy Policy
