protego
A pure-Python robots.txt parser with support for modern conventions
Installation
To install this package, run one of the following:
Usage Tracking
0.5.0
0.4.0
0.3.1
0.3.0
0.2.1
5 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
A pure-Python robots.txt parser with support for modern conventions
Last Updated
Jun 24, 2025 at 17:42
License
BSD-3-Clause-Clear
Total Downloads
336.2K
Supported Platforms
noarch