tokenize-rt
A wrapper around the stdlib `tokenize` which roundtrips.
Installation
To install this package, run one of the following:
Usage Tracking
6.0.0
1 / 8 versions selected
Downloads (Last 6 months): 0
Description
The stdlib tokenize module does not properly roundtrip. This wrapper around the stdlib provides two additional tokens and a Token data type. Use srctotokens and tokenstosrc to roundtrip.
About
Summary
A wrapper around the stdlib `tokenize` which roundtrips.
Last Updated
Oct 18, 2024 at 17:35
License
MIT
Total Downloads
26.3K
Supported Platforms
noarch