Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Pages are indexed even after blocking in robots.txt

g1smd - 8:28 pm on Oct 9, 2012 (gmt 0)


Which UA and IP was snooping about?

For your blocking rules, which UA did you target for those specific URLs? Does your robots.txt file have separate sections for different UAs.

Thread source:: http://www.webmasterworld.com/google/4490125.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com