Files | Anaconda.org

HuggingFace / packages / tokenizers

1

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	2.9 MB	\| win-64/tokenizers-0.12.0-py39_0.tar.bz2	2 years and 10 months ago	22	main
conda	2.9 MB	\| win-64/tokenizers-0.12.0-py38_0.tar.bz2	2 years and 10 months ago	18	main
conda	2.9 MB	\| win-64/tokenizers-0.12.0-py37_0.tar.bz2	2 years and 10 months ago	16	main
conda	3.2 MB	\| osx-64/tokenizers-0.12.0-py39_0.tar.bz2	2 years and 10 months ago	12	main
conda	3.1 MB	\| osx-64/tokenizers-0.12.0-py38_0.tar.bz2	2 years and 10 months ago	10	main
conda	3.2 MB	\| osx-64/tokenizers-0.12.0-py37_0.tar.bz2	2 years and 10 months ago	12	main
conda	4.2 MB	\| linux-64/tokenizers-0.12.0-py39_0.tar.bz2	2 years and 10 months ago	28	main
conda	4.2 MB	\| linux-64/tokenizers-0.12.0-py38_0.tar.bz2	2 years and 10 months ago	29	main
conda	4.2 MB	\| linux-64/tokenizers-0.12.0-py37_0.tar.bz2	2 years and 10 months ago	25	main