Forum Moderators: buckworks & skibum

Message Too Old, No Replies

Google's AdWords spider load increasing

Google eating bandwidth

         

westsider

5:30 am on Mar 3, 2007 (gmt 0)

10+ Year Member



I've been noticing a large increase in traffic from Google (IP 66.249.66.235) which I assume is associated with more aggressive landing page testing. It appears that it's averaging 2 QPS, which is eating a lot of bandwidth and loading the servers -- all day long.

Is it possible to arrange with Google to visit less frequently?

centime

8:39 am on Mar 3, 2007 (gmt 0)

10+ Year Member



You can via a site map an opening a webmasters tools account.

However, you might start to miss the spiders profitable pressence :-)

westsider

2:49 pm on Mar 4, 2007 (gmt 0)

10+ Year Member



AdWords has been "evaluating" the landing page of the urls in the ads since July, 2006. However, starting about a week ago, they made new changes that causes, I believe, the spider to visit my site much more often. I'm getting at least 60,000 page requests a day. I was wondering if there was a way to throttle this back.

My webmaster tools showed that I haven't been indexed since 2/25/07 so I don't think its the "organic" spider.

[edited by: tedster at 6:27 pm (utc) on Mar. 4, 2007]
[edit reason] relocating the thread [/edit]