Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
A new user experience is coming soon! These rolling changes are ongoing and some pages will still have the old user interface.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: All
All
0.23.1
0.22.2
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
4.5 MB
|
linux-aarch64/tokenizers-0.13.1-py39h509f947_2.tar.bz2
3 years and 8 months ago
201
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py310h26665ef_2.tar.bz2
3 years and 8 months ago
148
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py311h7f5e267_2.tar.bz2
3 years and 8 months ago
90
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py38h2e5b999_2.tar.bz2
3 years and 8 months ago
110
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py39h4d2953e_2.tar.bz2
3 years and 8 months ago
16020
main
conda
4.5 MB
|
linux-64/tokenizers-0.13.1-py311h0ecb24d_2.tar.bz2
3 years and 8 months ago
3240
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py311h5aa5048_2.tar.bz2
3 years and 8 months ago
51
main
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py311h1a89b9f_2.tar.bz2
3 years and 8 months ago
162
main
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py310h9fd527c_2.tar.bz2
3 years and 8 months ago
155
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py311h80b4070_2.tar.bz2
3 years and 8 months ago
97
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py39h4854364_2.tar.bz2
3 years and 8 months ago
100
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py310h2600717_2.tar.bz2
3 years and 8 months ago
93
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py310h563f291_2.tar.bz2
3 years and 8 months ago
116
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py310h095db6c_2.tar.bz2
3 years and 8 months ago
94
main
conda
2.9 MB
|
win-64/tokenizers-0.13.1-py38h80111bd_2.tar.bz2
3 years and 8 months ago
154
main
conda
4.5 MB
|
linux-aarch64/tokenizers-0.13.1-py38h22079e3_2.tar.bz2
3 years and 8 months ago
94
main
conda
5.1 MB
|
linux-ppc64le/tokenizers-0.13.1-py38h70f91e2_2.tar.bz2
3 years and 8 months ago
53
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py311h503924a_2.tar.bz2
3 years and 8 months ago
90
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py310hcd6d504_2.tar.bz2
3 years and 8 months ago
90
main
conda
4.6 MB
|
linux-aarch64/tokenizers-0.13.1-py39h25ed3b3_2.tar.bz2
3 years and 8 months ago
427
main
conda
5.2 MB
|
linux-ppc64le/tokenizers-0.13.1-py39hb53b74b_2.tar.bz2
3 years and 8 months ago
59
main
conda
3.0 MB
|
win-64/tokenizers-0.13.1-py39h7bc27ca_2.tar.bz2
3 years and 8 months ago
561
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py39h48564e8_2.tar.bz2
3 years and 8 months ago
94
main
conda
3.3 MB
|
osx-64/tokenizers-0.13.1-py38h6704c74_2.tar.bz2
3 years and 8 months ago
96
main
conda
3.2 MB
|
osx-arm64/tokenizers-0.13.1-py38h7b0f6e5_2.tar.bz2
3 years and 8 months ago
92
main
« Previous
showing 34 of 48
Next »
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.23)
Legal
|
Privacy Policy
