Adsense Site Diagnostics Question

[con771]

when I review my site diagnosics I see numerous errors.
Under the 'blocked URL' section I always have "http://cache.search.yahoo-ht2.akadns.net.....Widgets.com" errors.

The errors are always different pages and 2-3 usually appear each day or two. (the pages work fine when I access them)

I have never added any robots.txt on my site and I am not sure how to approach this?

Any thoughts on the subject? I would like to have all robots access my site without errors.

[vero]

I get those also. I'm not sure - but maybe the robot.txt refers to a Yahoo robots file? It may be that the ads appear when someone's done a Yahoo search and gotten a cached version of the site, but then Yahoo blocks the Google bot?
Anyone know for sure?

[mayest]

I certainly don't know for sure, but I think that vero must be correct. My Robots.txt file doesn't block the AdSense bot from any page that would be cached by Yahoo. I added that URL to my whitelist in the hope that the error would go away. That URL does belong to Yahoo, so I assume that they are the ones blocking AdSense.

[LifeinAsia]

That's what I would assume. Although I think it's kind of funny that I get the same type of entry when the Blocked URL is a Google domain. :)

[leadegroot]

Read the error like this:
'when an instance of your adsense code stored on [cache.search.yahoo......] asked us to come visit, we were blocked by the [cache.search.yahoo......] robots.txt'

ie. yahoo (and many other services) have cached your page without altering the adsense. A visitor viewing that cache drew the attention of the media bot.
yahoo's robots.txt blocked media bot, and media bot reported same.

Basically, the mediabot lacks the smarts to spot that its a cache page showing your adsense, not a 'real' page.

Nothing you need fix, nor worry about :)