Forum Moderators: martinibuster

Message Too Old, No Replies

I wish Adsense would spider on off-peak hours

Google bots hitting in prime time

         

beggers

9:24 am on Sep 16, 2003 (gmt 0)

10+ Year Member



I wonder if AdSense might eventually give us the option to select an optimum time for spidering? My busiest site gets hits really hard right around the time when a certain TV show is on (in prime time). I had about 50 Google bots at the same time although some may have been from the Google search engine. On the other hand, maybe there are a ton of bots because lots of new content is appearing at that time?

In any event, this relentless spidering is really slowing down my site.

jonknee

2:31 am on Sep 17, 2003 (gmt 0)

10+ Year Member



Might be time to get a new server :). Or at least go static during the peak.

Jenstar

8:15 am on Sep 17, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I assume you have AdSense on message boards - as soon as someone requests a page running AdSense that is new, off runs the Google mediabot to spider the page.

You might be able to drop the AdSense team an email, and see what they say. But I would be reluctant to do so - that would have the potential for a lot of people to see charity ads when the would have otherwise seen targeted ads and might have clicked. I suspect your CTR would take a nose dive.

I run AdSense on forums - a month and a half ago when AdSense was having trouble for 3 or 4 days, all new threads started during those 3-4 days ended up showing charity ads only. And the result in the CTR was noticeable.

What about using some of that AdSense money and putting it into a speedier site?