Msg#: 4261259 posted 4:30 pm on Feb 1, 2011 (gmt 0)
I am back for some more expert advice, thanks in advance!
I have a personal blog (wordpress) and have decided to disallow indexing of tags and categories through an SEO plugin in the CMS. I have also disallowed any comment pages, any feed pages and basically anything that's not the actual post in my robots.txt.
My problem is that for some reason both Google and Yahoo are indexing some of the tag pages as well as some of the feed pages.
For example: www.mypersonalblog.com/the-post-name/feed www.mypersonalblog.com/category/the-category/feed
I have these all disallowed in my robots.txt file. Is there any other reason these would be indexed as pages? They aren't linked from anywhere, either on my site or anyone else's.
Interestingly, Bing is the only one following my instructions...