Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.9.4
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py39h8c9392a_1.tar.bz2
4 years and 10 months ago
1206
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py38h291c280_1.tar.bz2
4 years and 10 months ago
1432
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py36h01e22a4_1.tar.bz2
4 years and 10 months ago
747
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py37h537c2b9_1.tar.bz2
4 years and 10 months ago
2500
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py38h0582b0e_1.tar.bz2
4 years and 10 months ago
1133
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36h999cc91_1.tar.bz2
4 years and 10 months ago
965
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py38h781e378_1.tar.bz2
4 years and 10 months ago
8867
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py37h17e0dd7_1.tar.bz2
4 years and 10 months ago
32696
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36h2bc52f9_1.tar.bz2
4 years and 10 months ago
5366
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36hc84fb85_1.tar.bz2
4 years and 10 months ago
2513
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36hc3ca637_1.tar.bz2
4 years and 10 months ago
258
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py39h289741d_1.tar.bz2
4 years and 10 months ago
4070
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py37h7bba54e_1.tar.bz2
4 years and 10 months ago
1443
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py39h702b19a_1.tar.bz2
4 years and 10 months ago
379
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py36h01e22a4_0.tar.bz2
4 years and 10 months ago
357
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py37h537c2b9_0.tar.bz2
4 years and 10 months ago
363
main
conda
1.8 MB
|
win-64/tokenizers-0.9.4-py38h291c280_0.tar.bz2
4 years and 10 months ago
378
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36hc84fb85_0.tar.bz2
4 years and 10 months ago
2487
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py37h17e0dd7_0.tar.bz2
4 years and 10 months ago
2523
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py36h2bc52f9_0.tar.bz2
4 years and 10 months ago
2463
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36h999cc91_0.tar.bz2
4 years and 10 months ago
250
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py38h0582b0e_0.tar.bz2
4 years and 10 months ago
251
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py36hc3ca637_0.tar.bz2
4 years and 10 months ago
255
main
conda
1.8 MB
|
osx-64/tokenizers-0.9.4-py37h7bba54e_0.tar.bz2
4 years and 10 months ago
260
main
conda
2.6 MB
|
linux-64/tokenizers-0.9.4-py38h781e378_0.tar.bz2
4 years and 10 months ago
2542
main
« Previous
showing 0 of 1
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
