Forum Moderators: martinibuster

Message Too Old, No Replies

AdSense Shares Cache Data With AdWords Crawler

AdWords Crawling Failure Can Impact AdSense Ads

         

incrediBILL

7:34 am on Sep 11, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just had an unusual problem I thought I'd share for those running both AdSense and AdWords.

I used to run an AdWords campaign that has been idle for months.

Suddenly the landing page for that campaign started having completely off the wall ads, not even close to the content.

Turns out the only bot crawling that page was the AdsBot-Google for AdWords and it was being blocked.

Normally you only think about googlebot and mediapartners-google crawling and sharing cache pages for AdSense as they are the two main 'bots crawling your site.

However, I had completely forgotten about the old AdWords campaign and AdsBot-Google was definitely not authorized to crawl my site.

Allowing AdsBot-Google completely cleared up the problem.

So just a heads up for anyone running AdWords and AdSense, please make sure you allow AdsBot-Google on your site as well JUST IN CASE!

Lame_Wolf

7:02 pm on Sep 11, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Turns out the only bot crawling that page was the AdsBot-Google for AdWords and it was being blocked.

eh?
How do you know it was crawling if it was blocked. You've lost me here.

incrediBILL

10:08 pm on Sep 11, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It still shows up in the log files even if it's blocked.

Plus, my site publishes a special page to all blocked crawlers so I can see what they saw in their cache.

Lame_Wolf

3:52 am on Sep 12, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Thanks for clearing that up incrediBILL. :)