homepage Welcome to WebmasterWorld Guest from 54.197.66.57
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Google Site Diagnostics - robots.txt blocks urls
akreider

10+ Year Member



 
Msg#: 3207428 posted 12:04 am on Jan 4, 2007 (gmt 0)

Recently I did some changes to my robots.txt file and now I'm getting blocked urls in Google Site Diagnostics (for around 15 pages).

They look like this:

http:/ / 209. 85. 135. 104/ search? q= cache:1lNv7BWsX34J:www. mydomain. org/ blog/ node/ 58+yamaha+t-85&hl= de&gl= de&ct= clnk&cd= 6

Google says it is blocked by robots.txt.

I don't understand what is happening, since it looks like I'm blocking a cached version of my page? 209.85.135.104 is a google search page.

Also, none of my robots.txt file blocks my blog - so it shouldn't be blocked.

What is going on?

 

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3207428 posted 2:06 am on Jan 4, 2007 (gmt 0)

is that google sitemaps or google adsense giving you those results? google adsense has had problems with their reporting

akreider

10+ Year Member



 
Msg#: 3207428 posted 7:12 am on Jan 5, 2007 (gmt 0)

AdSense.

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3207428 posted 7:44 pm on Jan 5, 2007 (gmt 0)

that is an adsense bug that google needs to fix
i wouldn't worry to much about it

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved