Files | Anaconda.org

main / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	4.4 MB	\| linux-64/tokenizers-0.11.4-py37h3dcd8bd_1.tar.bz2	2 years and 10 months ago	68	main
conda	4.4 MB	\| linux-64/tokenizers-0.11.4-py310h3dcd8bd_1.tar.bz2	2 years and 10 months ago	251	main
conda	3.2 MB	\| osx-arm64/tokenizers-0.11.4-py39h5c5695e_0.tar.bz2	2 years and 10 months ago	3	main
conda	3.2 MB	\| osx-arm64/tokenizers-0.11.4-py38h5c5695e_0.tar.bz2	2 years and 10 months ago	4	main
conda	3.2 MB	\| osx-arm64/tokenizers-0.11.4-py310h5c5695e_0.tar.bz2	2 years and 10 months ago	4	main