💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
https://anaconda.org/huggingface/tokenizers/badges/version.svg
https://anaconda.org/huggingface/tokenizers/badges/latest_release_date.svg
https://anaconda.org/huggingface/tokenizers/badges/latest_release_relative_date.svg
https://anaconda.org/huggingface/tokenizers/badges/platforms.svg
https://anaconda.org/huggingface/tokenizers/badges/license.svg
https://anaconda.org/huggingface/tokenizers/badges/downloads.svg