Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
If so, did Inktomi(Guy) make a decision to only include PAID now?
I am throwing out these questions as I do not follow Ink that much and hoping to hear some responses from experts here!
In August I noted a substantial number of MSN hits (about 10% of my SE traffic), and at that time others started posting that it seemed that Inktomi had started spidering much of the whole web, whether the sites had paid or not.
I know nothing about the status of BOW, but clearly they are spidering many sites for free.
Interestingly, only the home pages of the sites are in ODP, but all pages are included in Ink, so the sites were fully spidered as a result of ODP inclusion - that's my theory, anyway.
I'm not sure how Ink works these days, but I'm grateful for the listings!
Many of the pages included were automated doorway pages that were cloaked, spanning multiple domains forwarding to common sites or mirror sites.
On popular searches these well "tuned" pages now appear at the top leaving "BOW" pages on following pages.
A. Aggressive formatting becomes a necessity to break above these pages.
B. Reporting the offenders removes them in around 60 days.
Defend, Protect and Police your home turf.
Secondly, the Best of the Web index has gone away as a separate database. Now that we've rearchitected, we don't need a separate database of frequently-crawled content. Everything is frequently-crawled content :-)