Files | Anaconda.org

HuggingFace / packages / tokenizers

1

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	1.9 MB	\| win-64/tokenizers-0.10.1-py38_0.tar.bz2	3 years and 9 months ago	695	main
conda	1.9 MB	\| win-64/tokenizers-0.10.1-py36_0.tar.bz2	3 years and 9 months ago	217	main
conda	1.9 MB	\| win-64/tokenizers-0.10.1-py37_0.tar.bz2	3 years and 9 months ago	362	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.1-py35_0.tar.bz2	3 years and 9 months ago	6	main
conda	1.9 MB	\| win-64/tokenizers-0.10.1-py35_0.tar.bz2	3 years and 9 months ago	11	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.1-py38_0.tar.bz2	3 years and 9 months ago	287	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.1-py35_0.tar.bz2	3 years and 9 months ago	17	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.1-py36_0.tar.bz2	3 years and 9 months ago	50	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.1-py37_0.tar.bz2	3 years and 9 months ago	148	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.1-py36_0.tar.bz2	3 years and 9 months ago	1325	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.1-py38_0.tar.bz2	3 years and 9 months ago	5568	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.1-py37_0.tar.bz2	3 years and 9 months ago	130430	main