Files | Anaconda.org

anaconda / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	3.3 MB	\| linux-s390x/tokenizers-0.15.1-py311ha9e02f1_0.tar.bz2	1 year and 2 months ago	7	main
conda	3.2 MB	\| linux-aarch64/tokenizers-0.15.1-py39hb4c1b22_0.tar.bz2	1 year and 2 months ago	4	main
conda	3.2 MB	\| linux-aarch64/tokenizers-0.15.1-py310hb4c1b22_0.tar.bz2	1 year and 2 months ago	4	main
conda	3.3 MB	\| linux-aarch64/tokenizers-0.15.1-py311hb4c1b22_0.tar.bz2	1 year and 2 months ago	3	main
conda	3.2 MB	\| linux-aarch64/tokenizers-0.15.1-py38hb4c1b22_0.tar.bz2	1 year and 2 months ago	4	main