protego
A pure-Python robots.txt parser with support for modern conventions
Installation
To install this package, run one of the following:
Installation commands are not available for this package.
Usage Tracking
0 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
A pure-Python robots.txt parser with support for modern conventions
Last Updated
Jun 24, 2025 at 17:42
License
BSD-3-Clause-Clear
Total Downloads
0