Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How should I use a robots.txt file on a virtual account?
soccer_star - 2:01 pm on Jun 10, 2004 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/401.htm
Thanks for the tip Jim, I tested it how you suggested and the robots.txt appeared for the ignored-site.com and I got 404 for the others, so it appears to have worked. :)
Brought to you by WebmasterWorld: http://www.webmasterworld.com