Page is a not externally linkable
-- Google SEO News and Discussion
---- Pages are indexed even after blocking in robots.txt
Hollywood - 9:47 pm on Oct 9, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/google/4490125.htm
g1smd, I could find the bots that checked again but not at that location. My robots.txt is super simple
And they went to those files /red-bot.html anyway... a few times.
Brought to you by WebmasterWorld: http://www.webmasterworld.com