Files | Anaconda.org

ab-geo / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	2.8 MB	\| linux-64/tokenizers-0.15.0-py39_0.conda	1 year and 4 months ago	8	main
conda	2.8 MB	\| linux-64/tokenizers-0.15.0-py311_0.conda	1 year and 4 months ago	21	main
conda	2.8 MB	\| linux-64/tokenizers-0.15.0-py310_0.conda	1 year and 4 months ago	10	main
conda	1.6 MB	\| win-64/tokenizers-0.15.0-py311_0.conda	1 year and 4 months ago	49	main