Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robot.txt


jaysh4922 - 12:52 pm on Nov 7, 2012 (gmt 0)


The robots.txt file is placed in your www or public directory.the correct location where to put this file is in www.yourdomainname.com/robots.txt. This file indicates how deep the spiders can crawl into your website.


Thread source:: http://www.webmasterworld.com/robots_txt/4516756.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com