protego
A pure-Python robots.txt parser with support for modern conventions
Installation
To install this package, run one of the following:
Installation commands are not available for this package.
Usage Tracking
latest
1 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
A pure-Python robots.txt parser with support for modern conventions
Last Updated
Mar 2, 2026 at 12:48
License
BSD-3-Clause-Clear