Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- And Now Google's Doing It. JS Stats Show GoogleBot
g1smd - 7:57 am on May 14, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4312058.htm
The robots noindex meta tag is all about "do not index".
The robots.txt disallow is "do not crawl" (but the URL might still appear as a URL-only entry in the SERPs).
Brought to you by WebmasterWorld: http://www.webmasterworld.com