Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.10.3
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_1.tar.bz2
4 years and 23 hours ago
11928
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_1.tar.bz2
4 years and 23 hours ago
12301
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_1.tar.bz2
4 years and 1 day ago
140
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py36hd885b9d_1.tar.bz2
4 years and 1 day ago
116
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py38h291c280_1.tar.bz2
4 years and 1 day ago
3700
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py36h01e22a4_1.tar.bz2
4 years and 1 day ago
2288
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py37h537c2b9_1.tar.bz2
4 years and 1 day ago
2117
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py39h8c9392a_1.tar.bz2
4 years and 1 day ago
4303
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py38he82c38c_1.tar.bz2
4 years and 1 day ago
1691
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py37hd52b43c_1.tar.bz2
4 years and 1 day ago
618
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py38h7d8d1bc_1.tar.bz2
4 years and 1 day ago
1119
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py36h95e621a_1.tar.bz2
4 years and 1 day ago
514
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py39hab32027_1.tar.bz2
4 years and 1 day ago
2087
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py38ha05bbb4_1.tar.bz2
4 years and 1 day ago
120
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.10.3-py39h709bb41_1.tar.bz2
4 years and 1 day ago
113
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py39h1c16480_1.tar.bz2
4 years and 1 day ago
2594
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py37hcb7a40c_1.tar.bz2
4 years and 1 day ago
6930
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py36h868246f_1.tar.bz2
4 years and 1 day ago
79
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py37hde4f5c7_1.tar.bz2
4 years and 1 day ago
87
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py36h589faa6_1.tar.bz2
4 years and 1 day ago
4256
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py39hd6d55de_1.tar.bz2
4 years and 1 day ago
628609
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py38hb63a372_1.tar.bz2
4 years and 1 day ago
42403
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_0.tar.bz2
4 years and 2 days ago
92
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_0.tar.bz2
4 years and 2 days ago
90
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_0.tar.bz2
4 years and 2 days ago
95
main
« Previous
showing 0 of 2
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
