Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and multiple domain names

Using a Virtual Server...



7:45 pm on Mar 26, 2004 (gmt 0)

10+ Year Member

If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?

Featured Threads

Hot Threads This Week

Hot Threads This Month