Menu
About
Anaconda
Help
Download Anaconda
Sign In
Anaconda.com
A new user experience is coming soon! These rolling changes are ongoing and some pages will still have the old user interface.
conda-forge
/
packages
/
tokenizers
1
Fast State-of-the-Art Tokenizers optimized for Research and Production
copied from
cf-post-staging /
tokenizers
Conda
Files
Labels
Badges
Error
No files were selected
×
Filters
Type: All
All
conda
Version: All
All
0.23.1
0.22.2
0.22.1
0.22.0
0.21.4
0.21.3
0.21.2
0.21.1
0.21.0
0.20.4
0.20.3
0.20.2
0.20.1
0.20.0
0.19.1
0.19.0
0.15.2
0.15.1
0.15.0
0.14.1
0.14.0
0.13.3
0.13.2
0.13.1
0.12.1
0.12.0
0.11.6
0.11.5
0.11.4
0.11.3
0.11.2
0.11.1
0.11.0
0.10.3
0.10.1
0.9.4
0.9.3
0.8.1
0.8.0
Label: All
All
Files with no label
main
Type
Size
Name
Uploaded
Downloads
Labels
conda
4.3 MB
|
linux-aarch64/tokenizers-0.12.0-py37h2c05718_0.tar.bz2
4 years and 3 months ago
98
main
conda
4.3 MB
|
linux-64/tokenizers-0.12.0-py39h312a7cb_0.tar.bz2
4 years and 3 months ago
3235
main
conda
4.4 MB
|
linux-aarch64/tokenizers-0.11.6-py39h5854805_0.tar.bz2
4 years and 4 months ago
97
main
conda
4.4 MB
|
linux-aarch64/tokenizers-0.11.6-py37h2c05718_0.tar.bz2
4 years and 4 months ago
101
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.6-py37h8ff4856_0.tar.bz2
4 years and 4 months ago
58
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.6-py38h21bfc59_0.tar.bz2
4 years and 4 months ago
58
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.6-py39h0ae05b8_0.tar.bz2
4 years and 4 months ago
54
main
conda
4.4 MB
|
linux-aarch64/tokenizers-0.11.6-py38ha50258e_0.tar.bz2
4 years and 4 months ago
100
main
conda
3.0 MB
|
win-64/tokenizers-0.11.6-py39h8c9392a_0.tar.bz2
4 years and 4 months ago
762
main
conda
3.0 MB
|
win-64/tokenizers-0.11.6-py38h291c280_0.tar.bz2
4 years and 4 months ago
192
main
conda
3.0 MB
|
win-64/tokenizers-0.11.6-py37h537c2b9_0.tar.bz2
4 years and 4 months ago
177
main
conda
3.3 MB
|
osx-64/tokenizers-0.11.6-py37h2203242_0.tar.bz2
4 years and 4 months ago
113
main
conda
3.1 MB
|
osx-arm64/tokenizers-0.11.6-py38hf0d1e3c_0.tar.bz2
4 years and 4 months ago
128
main
conda
3.1 MB
|
osx-arm64/tokenizers-0.11.6-py39h95755d3_0.tar.bz2
4 years and 4 months ago
135
main
conda
3.3 MB
|
osx-64/tokenizers-0.11.6-py38h8c440c4_0.tar.bz2
4 years and 4 months ago
114
main
conda
3.3 MB
|
osx-64/tokenizers-0.11.6-py39ha9c964b_0.tar.bz2
4 years and 4 months ago
123
main
conda
4.4 MB
|
linux-64/tokenizers-0.11.6-py38h63c213b_0.tar.bz2
4 years and 4 months ago
2552
main
conda
4.4 MB
|
linux-64/tokenizers-0.11.6-py39h312a7cb_0.tar.bz2
4 years and 4 months ago
3269
main
conda
4.4 MB
|
linux-64/tokenizers-0.11.6-py37h18700ff_0.tar.bz2
4 years and 4 months ago
2647
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.5-py37hde4f5c7_0.tar.bz2
4 years and 4 months ago
53
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.5-py38ha05bbb4_0.tar.bz2
4 years and 4 months ago
51
main
conda
5.0 MB
|
linux-ppc64le/tokenizers-0.11.5-py39h709bb41_0.tar.bz2
4 years and 4 months ago
51
main
conda
4.4 MB
|
linux-aarch64/tokenizers-0.11.5-py37h21574f2_0.tar.bz2
4 years and 4 months ago
97
main
conda
4.4 MB
|
linux-aarch64/tokenizers-0.11.5-py39hfc91441_0.tar.bz2
4 years and 4 months ago
98
main
conda
3.0 MB
|
win-64/tokenizers-0.11.5-py39h8c9392a_0.tar.bz2
4 years and 4 months ago
753
main
« Previous
showing 39 of 48
Next »
© 2026 Anaconda, Inc. All Rights Reserved. (v4.2.23)
Legal
|
Privacy Policy
