Forum Moderators: open

Message Too Old, No Replies

UA: XML Sitemaps Generator

         

tangor

1:35 pm on May 24, 2020 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



In all my years on the web this is the first time a third party ran this on my site:

UA: Mozilla/5.0 (compatible; XML Sitemaps Generator; www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0
IP 81.19.188.xxx

Robots.txt: NO

Took about about a third of my site. Unless there is a compelling reason why I shouldn't this little puppy has just entered my deny list.

not2easy

2:42 pm on May 24, 2020 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



The IP listed is for UKSERVERS, but it is likely a distributed bot so the UA block makes sense.

81.19.176.0 - 81.19.191.255
81.19.176.0/20