Page is a not externally linkable
jaysh4922 - 12:52 pm on Nov 7, 2012 (gmt 0)
The robots.txt file is placed in your www or public directory.the correct location where to put this file is in www.yourdomainname.com/robots.txt. This file indicates how deep the spiders can crawl into your website.