Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: conda
All
conda
Version: 0.9.4
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py39h8c9392a_1.tar.bz2
4 years and 10 months ago
1209
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py38h291c280_1.tar.bz2
4 years and 10 months ago
1436
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py36h01e22a4_1.tar.bz2
4 years and 10 months ago
749
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py37h537c2b9_1.tar.bz2
4 years and 10 months ago
2507
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py38h0582b0e_1.tar.bz2
4 years and 10 months ago
1136
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36h999cc91_1.tar.bz2
4 years and 10 months ago
968
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py38h781e378_1.tar.bz2
4 years and 10 months ago
8915
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py37h17e0dd7_1.tar.bz2
4 years and 10 months ago
32739
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36h2bc52f9_1.tar.bz2
4 years and 10 months ago
5402
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36hc84fb85_1.tar.bz2
4 years and 10 months ago
2555
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36hc3ca637_1.tar.bz2
4 years and 10 months ago
261
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py39h289741d_1.tar.bz2
4 years and 10 months ago
4118
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py37h7bba54e_1.tar.bz2
4 years and 10 months ago
1446
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py39h702b19a_1.tar.bz2
4 years and 10 months ago
382
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py36h01e22a4_0.tar.bz2
4 years and 10 months ago
360
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py37h537c2b9_0.tar.bz2
4 years and 10 months ago
366
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py38h291c280_0.tar.bz2
4 years and 10 months ago
381
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36hc84fb85_0.tar.bz2
4 years and 10 months ago
2530
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py37h17e0dd7_0.tar.bz2
4 years and 10 months ago
2564
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36h2bc52f9_0.tar.bz2
4 years and 10 months ago
2503
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36h999cc91_0.tar.bz2
4 years and 10 months ago
253
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py38h0582b0e_0.tar.bz2
4 years and 10 months ago
254
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36hc3ca637_0.tar.bz2
4 years and 10 months ago
258
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py37h7bba54e_0.tar.bz2
4 years and 10 months ago
263
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py38h781e378_0.tar.bz2
4 years and 10 months ago
2580
main
« Previous
showing 1 of 1
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
