Forum Moderators: open

Message Too Old, No Replies

MediaPartners spider

Ban this one

         

Digger

7:02 am on Jul 23, 2003 (gmt 0)

10+ Year Member



Yet another spider that ignored robots.txt:

UserAgent: Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)

IP address: 64.68.87.69
Host name: crawler9.googlebot.com

volatilegx

7:42 pm on Jul 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ban Googlebot? You've got to be kidding! I wonder if you have a problem in your robots.txt file that's causing it to be disregarded.