Welcome to WebmasterWorld Guest from 54.159.165.175

Forum Moderators: goodroi

robots.txt and multiple domain names

Using a Virtual Server...

   
7:45 pm on Mar 26, 2004 (gmt 0)

10+ Year Member



If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month