Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.10.3
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_1.tar.bz2
4 years and 21 hours ago
11928
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_1.tar.bz2
4 years and 21 hours ago
12301
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_1.tar.bz2
4 years and 22 hours ago
140
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py36hd885b9d_1.tar.bz2
4 years and 22 hours ago
116
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py38h291c280_1.tar.bz2
4 years and 1 day ago
3699
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py36h01e22a4_1.tar.bz2
4 years and 1 day ago
2287
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py37h537c2b9_1.tar.bz2
4 years and 1 day ago
2116
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py39h8c9392a_1.tar.bz2
4 years and 1 day ago
4302
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py38he82c38c_1.tar.bz2
4 years and 1 day ago
1691
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py37hd52b43c_1.tar.bz2
4 years and 1 day ago
617
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py38h7d8d1bc_1.tar.bz2
4 years and 1 day ago
1118
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py36h95e621a_1.tar.bz2
4 years and 1 day ago
513
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py39hab32027_1.tar.bz2
4 years and 1 day ago
2087
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py38ha05bbb4_1.tar.bz2
4 years and 1 day ago
120
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.10.3-py39h709bb41_1.tar.bz2
4 years and 1 day ago
113
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py39h1c16480_1.tar.bz2
4 years and 1 day ago
2593
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py37hcb7a40c_1.tar.bz2
4 years and 1 day ago
6930
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py36h868246f_1.tar.bz2
4 years and 1 day ago
79
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py37hde4f5c7_1.tar.bz2
4 years and 1 day ago
87
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py36h589faa6_1.tar.bz2
4 years and 1 day ago
4255
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py39hd6d55de_1.tar.bz2
4 years and 1 day ago
628608
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py38hb63a372_1.tar.bz2
4 years and 1 day ago
42403
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_0.tar.bz2
4 years and 2 days ago
92
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_0.tar.bz2
4 years and 2 days ago
90
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_0.tar.bz2
4 years and 2 days ago
95
main
« Previous
showing 0 of 2
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
