Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How to stop google from indexing wordpress blog paginated archive


phranque - 8:50 pm on Sep 15, 2012 (gmt 0)


the Disallow directive in robots.txt is about crawling, not indexing.
you probably want to implement a meta robots noindex element or the X-Robots-Tag; noindex HTTP Response header.


Thread source:: http://www.webmasterworld.com/robots_txt/4495192.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com