Recently when visitng the Google Adsense site I have noticed the following message at the top of the page: "Your ads have recently appeared on websites you haven't authorised. To avoid lost revenue, make sure that you authorise any sites where you display ads by visiting your account settings."
On the odd occasion I have actually found a site that I needed to 'allow' (mainly google translate, bing, etc), but lately I have not been finding any sites that needed allowing; instead I have 'crawler errors' instead.
My problem is that all the crawler errors relate to my robots.txt file. This is the type of error I see (please note I have removed the website details and replaced the site name with with an *):
[
tw.babelfish.yahoo.com...]
The contetns of my robots.txt file is s follows:
user-agent: mediapartners-google*
disallow:
That is it, nothing more.
Where are these errors coming from? They are not in the robots.txt so how is google finding them and reporting them as so called errors? Currently I have 17 such errors starting from the 15 May.
