Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and multiple domain names

Using a Virtual Server...

7:45 pm on Mar 26, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 11, 2003
votes: 0

If I have many domains pointing to one local directory, how do I limit the spiders to searching only ONE of those domains, and not letting it spider the rest?

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members