json-stream-rs-tokenizer
A faster tokenizer for the json-stream Python library
A faster tokenizer for the json-stream Python library
To install this package, run one of the following:
A faster tokenizer for the json-stream Python library. It's actually just json-stream's own tokenizer (itself adapted from the NAYA project) ported to Rust almost verbatim and made available as a Python module using PyO3. On my machine, it speeds up parsing by a factor of 4–10, depending on the nature of the data.
Summary
A faster tokenizer for the json-stream Python library
Information Last Updated
Mar 25, 2025 at 16:20
License
MIT
Total Downloads
4
GitHub Repository
https://github.com/smheidrich/py-json-stream-rs-tokenizer