Files | Anaconda.org

main / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	2.4 MB	\| linux-aarch64/tokenizers-0.21.0-py310hdc1999c_0.tar.bz2	18 days and 16 hours ago	1	main
conda	2.5 MB	\| linux-64/tokenizers-0.21.0-py311h5e3497e_0.tar.bz2	18 days and 16 hours ago	10	main
conda	2.5 MB	\| linux-64/tokenizers-0.21.0-py312h526025d_0.tar.bz2	18 days and 16 hours ago	11	main
conda	2.5 MB	\| linux-64/tokenizers-0.21.0-py313hb8e4a85_0.tar.bz2	18 days and 16 hours ago	9	main
conda	2.5 MB	\| linux-64/tokenizers-0.21.0-py310ha92566c_0.tar.bz2	18 days and 16 hours ago	18	main