Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How should I use a robots.txt file on a virtual account?


jdMorgan - 9:41 pm on Jun 9, 2004 (gmt 0)


Don't think server files and directories, think URLs.

Put it wherever http://www.ignoredsite.com/robots.txt will access it. And yes, that's probably the same directory as the index file, but it does depend on your server configuration. But just upload it there and test by typing the robots.txt URL into your browser.

If you're worried about the other domains, then test them, too. If you haven't put a robots.txt on them, you should get a 404.

Jim


Thread source:: http://www.webmasterworld.com/robots_txt/401.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com