pytokens
A fast, spec-compliant Python tokenizer
- Overview
- Files 44
- Labels 1
- Badges
Installation
To install this package, run one of the following:
Usage Tracking
0.3.0
0.2.0
2 / 8 versions selected
Total downloads: 0
Description
A fast, spec-compliant Python tokenizer that runs on older Pythons.
About
Summary
A fast, spec-compliant Python tokenizer
Information Last Updated
Dec 1, 2025 at 06:13
License
MIT
Total Downloads
2.0K
Platforms
macOS arm64 Version: 0.3.0
Win 64 Version: 0.3.0
Linux 64 Version: 0.3.0
Linux aarch64 Version: 0.3.0
GitHub Repository
https://github.com/tusharsadhwani/pytokens