Manage | Anaconda.org

main / packages / tokenizers

0

Fast State-of-the-Art Tokenizers optimized for Research and Production

Filters

Type	Size	Name	Uploaded	Downloads	Labels
conda	2.4 MB	\| osx-arm64/tokenizers-0.21.4-py314hc976446_0.tar.bz2	4 hours and 52 minutes ago	0	main
conda	2.4 MB	\| osx-arm64/tokenizers-0.21.4-py313h01c5644_0.tar.bz2	4 hours and 52 minutes ago	0	main
conda	2.4 MB	\| osx-arm64/tokenizers-0.21.4-py312h01c5644_0.tar.bz2	4 hours and 52 minutes ago	0	main
conda	2.6 MB	\| linux-aarch64/tokenizers-0.21.4-py314he4e7637_0.tar.bz2	4 hours and 52 minutes ago	2	main
conda	2.4 MB	\| osx-arm64/tokenizers-0.21.4-py311h01c5644_0.tar.bz2	4 hours and 52 minutes ago	0	main
conda	2.4 MB	\| osx-arm64/tokenizers-0.21.4-py310h01c5644_0.tar.bz2	4 hours and 52 minutes ago	0	main
conda	2.6 MB	\| linux-aarch64/tokenizers-0.21.4-py313h3cb5f8e_0.tar.bz2	4 hours and 52 minutes ago	2	main
conda	2.6 MB	\| linux-aarch64/tokenizers-0.21.4-py312h3cb5f8e_0.tar.bz2	4 hours and 52 minutes ago	2	main
conda	2.6 MB	\| linux-aarch64/tokenizers-0.21.4-py311h3cb5f8e_0.tar.bz2	4 hours and 52 minutes ago	2	main
conda	2.6 MB	\| linux-aarch64/tokenizers-0.21.4-py310h3cb5f8e_0.tar.bz2	4 hours and 52 minutes ago	2	main
conda	2.3 MB	\| win-64/tokenizers-0.21.4-py314ha18aedc_0.tar.bz2	4 hours and 56 minutes ago	4	main
conda	2.3 MB	\| win-64/tokenizers-0.21.4-py312h1794265_0.tar.bz2	4 hours and 56 minutes ago	4	main
conda	2.3 MB	\| win-64/tokenizers-0.21.4-py311h1794265_0.tar.bz2	4 hours and 56 minutes ago	4	main
conda	2.3 MB	\| win-64/tokenizers-0.21.4-py313h1794265_0.tar.bz2	4 hours and 56 minutes ago	4	main
conda	2.3 MB	\| win-64/tokenizers-0.21.4-py310h1794265_0.tar.bz2	4 hours and 56 minutes ago	4	main