homepage Welcome to WebmasterWorld Guest from 54.211.219.178
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Google Site Diagnostics - robots.txt blocks urls
akreider




msg:3207430
 12:04 am on Jan 4, 2007 (gmt 0)

Recently I did some changes to my robots.txt file and now I'm getting blocked urls in Google Site Diagnostics (for around 15 pages).

They look like this:

http:/ / 209. 85. 135. 104/ search? q= cache:1lNv7BWsX34J:www. mydomain. org/ blog/ node/ 58+yamaha+t-85&hl= de&gl= de&ct= clnk&cd= 6

Google says it is blocked by robots.txt.

I don't understand what is happening, since it looks like I'm blocking a cached version of my page? 209.85.135.104 is a google search page.

Also, none of my robots.txt file blocks my blog - so it shouldn't be blocked.

What is going on?

 

goodroi




msg:3207507
 2:06 am on Jan 4, 2007 (gmt 0)

is that google sitemaps or google adsense giving you those results? google adsense has had problems with their reporting

akreider




msg:3209012
 7:12 am on Jan 5, 2007 (gmt 0)

AdSense.

goodroi




msg:3209688
 7:44 pm on Jan 5, 2007 (gmt 0)

that is an adsense bug that google needs to fix
i wouldn't worry to much about it

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved