The left hand and the right hand

AdSense does not know what Google does

[jetteroheller]

Just looked in the AdSense console on diagnostic.

I have several pages listed where the Page can not be crawled because of robots.txt

The joke on this is, that all listed URLs are IP addressed from Google, with one of my pages shown in the cache.

So the Google AdSense spider can not spider this pages because the robots.txt of Google search engine does not allow to spider cached pages.

[plasma]

There is already a discussion about that on /google/.