Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and multiple domain names

Using a Virtual Server...

         

nerolabs

7:45 pm on Mar 26, 2004 (gmt 0)

10+ Year Member



If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?