CMD + K

json-stream-rs-tokenizer

Community

A faster tokenizer for the json-stream Python library

Installation

To install this package, run one of the following:

Conda
$conda install ad-testing::json-stream-rs-tokenizer

Usage Tracking

0.4.22
1 / 8 versions selected
Total downloads: 0

Description

A faster tokenizer for the json-stream Python library. It's actually just json-stream's own tokenizer (itself adapted from the NAYA project) ported to Rust almost verbatim and made available as a Python module using PyO3. On my machine, it speeds up parsing by a factor of 4–10, depending on the nature of the data.

About

Summary

A faster tokenizer for the json-stream Python library

Information Last Updated

Mar 25, 2025 at 16:20

License

MIT

Total Downloads

4