Welcome to WebmasterWorld Guest from 54.146.246.4

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and multiple domain names

Using a Virtual Server...

     

nerolabs

7:45 pm on Mar 26, 2004 (gmt 0)

10+ Year Member



If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?