Forum Moderators: open

Message Too Old, No Replies

Domain for Yahoo only

as ok in MSN & Google

         

stickyboy

9:35 am on May 18, 2005 (gmt 0)

10+ Year Member



I have a site which listed fine in both MSN & Google but doesnt exist as far as Yahoo as concerned (apparently was marked as spam back as July). This is basically a different site to the original and have contacted about getting it re-listed with them with no joy.

My plan is to copy all the content exactly as it is to another domain and edit the robots.txt so that Google and MSN bots ignore it so that it avoids any duplicate content on those search engines with the original domain.

A. Will this work ok? B. What exacly would the robots txt file say to exclude MSN & Google as dont want to muck it up!

Thanks

Adversity Sure Fire

5:04 am on May 19, 2005 (gmt 0)

10+ Year Member



Yes, it would work. As i was facing the same problem.

You can create a robot file, which indicates yahoo robot "slurp" to read all the content and not other search engines "*"

Let me know if you have any queries...

stickyboy

9:30 am on May 19, 2005 (gmt 0)

10+ Year Member



what would the exact content of the robots.txt file as I dont want to bugger it up and let google and msn spider it!

Adversity Sure Fire

9:54 am on May 19, 2005 (gmt 0)

10+ Year Member



I did it for Google and msn not for yahoo.

stickyboy

10:18 am on May 19, 2005 (gmt 0)

10+ Year Member



I have got this in my robots.txt - will this work?

User-agent: Slurp
Disallow:

User-agent: Googlebot
Disallow:/

User-agent: MSNbot
Disallow:/

Adversity Sure Fire

4:50 am on May 23, 2005 (gmt 0)

10+ Year Member



It looks fine...

Just check at [searchengineworld.com...]