Is it harmful if google indexes my /feed/ directory?
how to dissallow safely
brokenbricks
11:28 pm on Sep 7, 2005 (gmt 0)
I noticed google has indexed one of my blogs using wordpress, which has an rss feed for every article I write in www.site.com/article/feed/ directory. It has indexed every /feed/ url on the site, close to 100 now...
It isn't recognized in google and shows a url only, is it harmful to my site to have this content spidered and indexed?
I though about dissallowing googlebot but don't wanna screw it up and get my whole site ignored.
MarkHutch
7:15 am on Sep 9, 2005 (gmt 0)
Google will look for content anywhere it can. I don't see how this could hurt you. You can use robots.txt to exclude that information, but I don't see any need to do that if the info is already public anyway.
Lord Majestic
2:42 pm on Sep 9, 2005 (gmt 0)
There could be an issue with duplicate content -- I'd say if you have URLs with print preview and normal web page, then its best to decide which one is more important to you, ie which ones you want visitors to come to first.