Files | Anaconda.org

HuggingFace / packages / tokenizers

1

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	2.0 MB	\| osx-64/tokenizers-0.10.3-py36_0.tar.bz2	3 years and 10 months ago	1679	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.3-py37_0.tar.bz2	3 years and 10 months ago	1998	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.3-py38_0.tar.bz2	3 years and 10 months ago	3241	main
conda	1.9 MB	\| win-64/tokenizers-0.10.3-py36_0.tar.bz2	3 years and 10 months ago	3432	main
conda	1.9 MB	\| win-64/tokenizers-0.10.3-py37_0.tar.bz2	3 years and 10 months ago	2830	main
conda	1.8 MB	\| win-64/tokenizers-0.10.3-py38_0.tar.bz2	3 years and 10 months ago	9358	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.3-py37_0.tar.bz2	3 years and 10 months ago	7688	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.3-py38_0.tar.bz2	3 years and 10 months ago	18381	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.3-py36_0.tar.bz2	3 years and 10 months ago	4117	main
conda	2.0 MB	\| osx-64/tokenizers-0.10.3-py35_0.tar.bz2	3 years and 10 months ago	9	main
conda	1.8 MB	\| win-64/tokenizers-0.10.3-py35_0.tar.bz2	3 years and 10 months ago	16	main
conda	2.8 MB	\| linux-64/tokenizers-0.10.3-py35_0.tar.bz2	3 years and 10 months ago	21	main