summaryrefslogtreecommitdiffstats
path: root/plugins/url_check_ng/robotparser2.py.diff
Commit message (Expand)AuthorAgeFilesLines
* * let linkchecker ignore robots.txt restrictionsBjoern Buerger2007-10-191-0/+44
generated by cgit v1.2.3 (git 2.39.1) at 2024-04-28 02:37:35 +0000