kanetrain - 9:50 pm on Dec 10, 2003 (gmt 0)

Looks like the other thread got deleted. They were talking about the same thing anyway.

Update:
We have found the bug or problem or whatever you want to call it. It's a problem with the INK algorithm and how they deal with duplicate content.

Basically, if a free site and a paying site have duplicate content, the paying site gets dropped to the bottom (penalized) and the freely crawled page gets boosted. So really, your PFI pages are still in the index and but just not visible on any searches becasue an orgaically crawled duplicate page has taken your place. I guess PT or Ineedhits (or any reseller) is compying with their part of the deal by getting you into the index... and Inktomi is really to blame for punishing the paying customers.

If another site has your content duplicated, then your site will get automatically dropped from the serps for any relevant search terms... except, of course, a search for your exact url (which a duplicate site obviously can't recreate).

So really a competitor can copy a page from you, post it on thier server... get it crawled and your site will automatically drop. To me it seems horribly backwards. Shouldn't the paying site get preferential treatment and the organically crawled duplicate site banned? It just opens it up for way too much abuse. People could set up fake sites with copies of their competitors pages... then their competitors sites would get dropped (assuming the competotirs are paying for inclusion, of course).

Fixes -
1. Change the content on your pages that are getting penalized.
2. Tell the other website (that is crawled for free) to change their content and hope they do.
3. Contact INK or your reseller and tell them that the INK algorithm is a mess and that they need to fix it
4. Get rid of all of your PFI listings and wait for an organic crawl.

We have a lot proof to back this up. Thanks to those of you who helped me find the issue.