Files | Anaconda.org

main / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	3.1 MB	\| linux-64/tokenizers-0.19.1-py39hff361bb_0.tar.bz2	6 months and 6 days ago	15	main
conda	3.1 MB	\| linux-64/tokenizers-0.19.1-py38hff361bb_0.tar.bz2	6 months and 6 days ago	15	main
conda	3.1 MB	\| linux-64/tokenizers-0.19.1-py312ha11519a_0.tar.bz2	6 months and 6 days ago	16	main
conda	3.1 MB	\| linux-64/tokenizers-0.19.1-py311h585d796_0.tar.bz2	6 months and 6 days ago	19	main
conda	3.1 MB	\| linux-64/tokenizers-0.19.1-py310hff361bb_0.tar.bz2	6 months and 6 days ago	15	main