Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
2025 Python Packaging Survey is now live!
Take the survey now
New Authentication Rolling Out
- We're upgrading our sign-in process to give you one account across all Anaconda products! Browser users will see a refreshed sign-in flow, while CLI users will experience no changes.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: 0.10.3
All
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_1.tar.bz2
4 years and 17 days ago
11932
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_1.tar.bz2
4 years and 17 days ago
12306
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_1.tar.bz2
4 years and 17 days ago
143
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py36hd885b9d_1.tar.bz2
4 years and 17 days ago
120
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py38h291c280_1.tar.bz2
4 years and 17 days ago
3707
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py36h01e22a4_1.tar.bz2
4 years and 17 days ago
2301
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py37h537c2b9_1.tar.bz2
4 years and 17 days ago
2121
main
conda
1.8 MB
|
win-64/tokenizers-0.10.3-py39h8c9392a_1.tar.bz2
4 years and 17 days ago
4326
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py38he82c38c_1.tar.bz2
4 years and 17 days ago
1696
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py37hd52b43c_1.tar.bz2
4 years and 17 days ago
621
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py38h7d8d1bc_1.tar.bz2
4 years and 17 days ago
1121
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py36h95e621a_1.tar.bz2
4 years and 17 days ago
516
main
conda
1.9 MB
|
osx-arm64/tokenizers-0.10.3-py39hab32027_1.tar.bz2
4 years and 17 days ago
2100
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py38ha05bbb4_1.tar.bz2
4 years and 17 days ago
121
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.10.3-py39h709bb41_1.tar.bz2
4 years and 17 days ago
115
main
conda
2.0 MB
|
osx-64/tokenizers-0.10.3-py39h1c16480_1.tar.bz2
4 years and 17 days ago
2605
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py37hcb7a40c_1.tar.bz2
4 years and 17 days ago
6974
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py36h868246f_1.tar.bz2
4 years and 17 days ago
80
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.10.3-py37hde4f5c7_1.tar.bz2
4 years and 17 days ago
88
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py36h589faa6_1.tar.bz2
4 years and 17 days ago
4304
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py39hd6d55de_1.tar.bz2
4 years and 17 days ago
628754
main
conda
4.6 MB
|
linux-64/tokenizers-0.10.3-py38hb63a372_1.tar.bz2
4 years and 17 days ago
42461
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py39hfc91441_0.tar.bz2
4 years and 18 days ago
96
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py38h0a8abf9_0.tar.bz2
4 years and 18 days ago
94
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.10.3-py37h21574f2_0.tar.bz2
4 years and 18 days ago
99
main
« Previous
showing 1 of 2
Next »
© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2)
Legal
|
Privacy Policy
