Files | Anaconda.org

HuggingFace / packages / tokenizers

1

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	1.8 MB	\| win-64/tokenizers-0.9.4-py36_0.tar.bz2	3 years and 11 months ago	806	main
conda	1.8 MB	\| win-64/tokenizers-0.9.4-py38_0.tar.bz2	3 years and 11 months ago	896	main
conda	1.8 MB	\| win-64/tokenizers-0.9.4-py37_0.tar.bz2	3 years and 11 months ago	1163	main
conda	1.9 MB	\| osx-64/tokenizers-0.9.4-py38_0.tar.bz2	3 years and 11 months ago	396	main
conda	1.8 MB	\| win-64/tokenizers-0.9.4-py35_0.tar.bz2	3 years and 11 months ago	10	main
conda	1.9 MB	\| osx-64/tokenizers-0.9.4-py36_0.tar.bz2	3 years and 11 months ago	196	main
conda	1.9 MB	\| osx-64/tokenizers-0.9.4-py37_0.tar.bz2	3 years and 11 months ago	552	main
conda	1.9 MB	\| osx-64/tokenizers-0.9.4-py35_0.tar.bz2	3 years and 11 months ago	6	main
conda	2.7 MB	\| linux-64/tokenizers-0.9.4-py35_0.tar.bz2	3 years and 11 months ago	16	main
conda	2.7 MB	\| linux-64/tokenizers-0.9.4-py36_0.tar.bz2	3 years and 11 months ago	2016	main
conda	2.7 MB	\| linux-64/tokenizers-0.9.4-py37_0.tar.bz2	3 years and 11 months ago	149135	main
conda	2.7 MB	\| linux-64/tokenizers-0.9.4-py38_0.tar.bz2	3 years and 11 months ago	2785	main