Welcome to WebmasterWorld Guest from 126.96.36.199
Moderators: DixonJones & mademetop
I see a lot of "whatevers" (bots probably, real humans, I doubt) reading my robots.txt... with no user agent.
Any reason not to just write a new rule in and just instantly ban anyone who reads robots.txt with no UA?
Pubcon Platinum Sponsor 2015