Files | Anaconda.org

conda-forge / packages / tokenizers

1

Fast State-of-the-Art Tokenizers optimized for Research and Production

copied from cf-post-staging / tokenizers

Filters

	Type	Size	Name	Uploaded	Downloads	Labels
	conda	3.0 MB	\| win-64/tokenizers-0.12.0-py38h291c280_0.tar.bz2	3 years and 5 months ago	170	main
	conda	3.0 MB	\| win-64/tokenizers-0.12.0-py39h8c9392a_0.tar.bz2	3 years and 5 months ago	750	main
	conda	3.2 MB	\| osx-64/tokenizers-0.12.0-py37h2203242_0.tar.bz2	3 years and 5 months ago	96	main
	conda	4.9 MB	\| linux-ppc64le/tokenizers-0.12.0-py39h0ae05b8_0.tar.bz2	3 years and 5 months ago	69	main
	conda	3.2 MB	\| osx-64/tokenizers-0.12.0-py39ha9c964b_0.tar.bz2	3 years and 5 months ago	98	main
	conda	3.0 MB	\| win-64/tokenizers-0.12.0-py37h537c2b9_0.tar.bz2	3 years and 5 months ago	147	main
	conda	3.1 MB	\| osx-arm64/tokenizers-0.12.0-py39h95755d3_0.tar.bz2	3 years and 5 months ago	118	main
	conda	4.9 MB	\| linux-ppc64le/tokenizers-0.12.0-py38h21bfc59_0.tar.bz2	3 years and 5 months ago	51	main
	conda	4.9 MB	\| linux-ppc64le/tokenizers-0.12.0-py37h8ff4856_0.tar.bz2	3 years and 5 months ago	49	main
	conda	3.2 MB	\| osx-64/tokenizers-0.12.0-py38h8c440c4_0.tar.bz2	3 years and 5 months ago	95	main
	conda	3.1 MB	\| osx-arm64/tokenizers-0.12.0-py38hf0d1e3c_0.tar.bz2	3 years and 5 months ago	123	main
	conda	4.3 MB	\| linux-aarch64/tokenizers-0.12.0-py38ha50258e_0.tar.bz2	3 years and 5 months ago	81	main
	conda	4.3 MB	\| linux-aarch64/tokenizers-0.12.0-py39h5854805_0.tar.bz2	3 years and 5 months ago	93	main
	conda	4.3 MB	\| linux-64/tokenizers-0.12.0-py38h63c213b_0.tar.bz2	3 years and 5 months ago	1976	main
	conda	4.3 MB	\| linux-64/tokenizers-0.12.0-py37h18700ff_0.tar.bz2	3 years and 5 months ago	1988	main
	conda	4.3 MB	\| linux-aarch64/tokenizers-0.12.0-py37h2c05718_0.tar.bz2	3 years and 5 months ago	80	main
	conda	4.3 MB	\| linux-64/tokenizers-0.12.0-py39h312a7cb_0.tar.bz2	3 years and 5 months ago	2637	main

© 2025 Anaconda, Inc. All Rights Reserved. (v4.2.2) Legal | Privacy Policy