Files | Anaconda.org

main / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	4.8 MB	\| linux-aarch64/tokenizers-0.13.3-py310hb4c1b22_0.tar.bz2	1 year and 5 months ago	3	main
conda	4.8 MB	\| linux-64/tokenizers-0.13.3-py39h22610ee_0.tar.bz2	1 year and 5 months ago	72	main
conda	4.8 MB	\| linux-64/tokenizers-0.13.3-py311h22610ee_0.tar.bz2	1 year and 5 months ago	72	main
conda	4.8 MB	\| linux-64/tokenizers-0.13.3-py38h22610ee_0.tar.bz2	1 year and 5 months ago	138	main
conda	4.8 MB	\| linux-64/tokenizers-0.13.3-py310h22610ee_0.tar.bz2	1 year and 5 months ago	47	main