Welcome to WebmasterWorld Guest from 184.108.40.206
joined:Dec 28, 2005
Maybe it is already old news to some, maybe i missed previous topics disscussing this. Anyway, it is the first time i see this thing in real time. Very interesting crawl development.
Anyone else noticed this ?
Page to page browsing was occuring at a very fast rate, could not be human.
jecasc - What identified this as a Google crawler?
The "who is online" shows the IP. I checked the IP on an IP lookup website and the IP was from Google. Also the requests came so fast that it could not possibly be a human search. Perhaps I would not have even noticed it if the search terms would not have been so odd. I also checked if there was a website somewhere linking to my website with the search terms, but I found none.
I have checked my logfiles of the past days and I found the same happening a few days ago:
User Agent: "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"