Forum Moderators: open
We're considering duplicating our site on .net or .org so that we can be reindexed by Yahoo. However, we don't want to be penalized by Google/MSN/etc for duplicate content. Does anyone know if there's a way to only open the site to Yahoo and then either let users from there browse that site or simply redirect them to the .com?
I know this sounds fishy and blackhat, but really the reason for our removal was not our fault, and Yahoo refuses to correct the issue forcing us to seek out means of going around it.
Any information on the safest and most legitimate way to do this would be appreciated. Thanks!
[edited by: martinibuster at 7:51 am (utc) on Oct. 2, 2006]
[edit reason] Added paragraph breaks so it's easy to read. [/edit]
the reason for our removal was not our fault, and Yahoo refuses to correct the issue...
Did you correct the issue on your end?
Did you correct the issue on your end?
The problem wasn't on our end, it was with a company that had C&D'd them with several hundred websites and for some reason ours was lumped in with those. Yahoo simply removed them all without actually looking at the sites. Once we explained this to them they referred us to the legal department after which our lawyers and their lawyers talked in circles for several months before deciding that Yahoo was just never going to do anything about it. The whole situation was a farce, and penalized us severely because in addition to being in their index we had over 30+ deep backlinks from the Yahoo directory that their own editors had added by hand.
Easy. Just use robots.txt or .htaccess to stop G and MSN from spidering the new site(s).
That's what I thought, but wasn't totally sure that would do the trick. 3 questions:
1) Are there any other engines/spiders we should add?
2) What's the right format for the robots.txt/.htaccess to block them properly?
3) Is there a way to 302 redirect all the pages to the .com for everyone except Yahoo? Or is the robots.txt/.htaccess a "better" solution?
Thanks for the feedback!
[edited by: ALbino at 4:25 pm (utc) on Oct. 2, 2006]
User-agent: Slurp
Disallow:
User-agent: *
Disallow: /
Then in a legal dispute with someone stealing our content we hired a law firm who had contacts within Yahoo and we finally had someone look into the situation. A Yahoo rep confirmed it was the links. We told them we stopped it almost as soon as it started and that our site was clean as one could get it. (We had just launched a completely brand new 250K site in Feb) They advised us that the penalty was removed but we still didn't rank for any of the old terms we used to. Since the penalty was "lifted" we have tried directory submit (removing old listing, resubmitting), search submit express for a couple months then stopping, all the while continuing our PPC campaign. Nothing worked and we still are nowhere to be found for our key terms.
Recently I've stopped the search submit express, reduced our PPC campaign from the thousands a week to hundreds and am essentially at the point of giving up on Yahoo with this domain.
Just last week I was just considering the same thing as you are. i.e. getting a new domain and placing a copy of our site on it and banning MSNbot and Gbot from it.
First off it makes me very upset that I've got to even consider this with a site like ours. We have so much unqiue content and great features on this site it's enough to make your head spin. Yet here I am having to resort to this sort of tactic because Yahoo can't get it's BLEEP together. GRRRR!
The thing is we have excellent ranking in Google and ok rankings in MSN. I know how often the engines don't obey the robots file, so I am extremely worried that if we do this, we may wind up losing our rankings in G.
Has anyone actually done this under the same or similar circumstances? I’d like to have some sense of security that we won't be shooting off our foot to save our face, if you know what I mean.
had contacts within Yahoo and we finally had someone look into the situation. A Yahoo rep confirmed it was the links.
time after time we hear this. Why is it 90% of lifted penalties are from someone who had a contact inside Yahoo and was told the exact reason for a ban.
[edited by: martinibuster at 8:11 am (utc) on Oct. 5, 2006]
[edit reason] See TOS. [/edit]
301 your site to a cruddy geocities page, don't apply any seo, and make sure your navigation is broke. Sure fire way to hit the top 10. hahaha ;)
User-agent: Slurp
Disallow:
User-agent: *
Disallow: /-superclown2
I think you have it backwards... The order you've listed them in would also block Slurp along with everything else.
I believe the correct robots.txt would be:
User-agent: *
Disallow: /
User-agent: Slurp
Disallow:
