database of robots.txt-derived permissions
anaconda login
conda install dan_blanchard::perl-www-robotrules