Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google Crawling Aggressively

25M per day from Googlebot

         

TomsBB

5:40 pm on Jul 30, 2005 (gmt 0)



hello,

A site has been crawled by crawl-66-249-65-78.googlebot.com generating 25MB bouts of traffic multiple times per day. At the same time the majority of traffic comes from other search engines/sites. What is the purpose of this crawl, if it does not appear to add to site ranking on google?

Just to put it into perspective, the same pattern of crawling of this site is seen with yahoo, but in this instance the site in top 10 on yahoo.

Thanks,
Leon