Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Pages are indexed even after blocking in robots.txt


tedster - 9:51 pm on Aug 31, 2012 (gmt 0)


Yep, I've seen it happen too. Apparently a URL in a sitemap is assumed to have a "crawl me, index me" sign on it that trumps any other signal that may be in place. So it pays to proofread your sitemap file and not just auto-generate it.


Thread source:: http://www.webmasterworld.com/google/4490125.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com