Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- ROBOTS.txt---Yes to Google, but No to Public view


donna130 - 2:31 am on Jan 11, 2010 (gmt 0)


Hi. I've got a robots.txt file that, of course, allows Google's crawler to crawl it. However (and I admit i'm a relative newbie) is there a way to restrict public (competitors) from viewing that robots.txt file? Thanks if you have some tricks or solutions to this problem.


Thread source:: http://www.webmasterworld.com/robots_txt/4058056.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com