Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and multiple domain names

Using a Virtual Server...

7:45 pm on Mar 26, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 11, 2003
votes: 0

If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?