Forum Moderators: buckworks & skibum

Message Too Old, No Replies

AdsBot-Google

         

tantalus

10:54 am on Aug 3, 2006 (gmt 0)

10+ Year Member



GET /robots.txt - 80 - 66.249.72.45 HTTP/1.1 AdsBot-Google (+http://www.google.com/adsbot.html)

GET /#*$!/#*$! - 80 - 72.14.199.2 HTTP/1.1 AdsBot-Google (+http://www.google.com/adsbot.html)

Angelis

10:58 am on Aug 3, 2006 (gmt 0)

10+ Year Member



Thanks for that, im sure a question will be following...

Could be Google looking for rewritten url's or 404 pages.

exmoorbeast

11:10 am on Aug 3, 2006 (gmt 0)

10+ Year Member



we had a bit of a huge crawl last night...i wonder if an update is due...any one else?

magicdan

11:19 am on Aug 3, 2006 (gmt 0)

10+ Year Member



Ive been watching the adsbot crawl alot of our pages for a week or so now. Seems to be checking out keywords that were previously inactive mostly.