Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: rogerd
Forget about the issues of content copyright and them milking ad revenue from it but what about the pros / cons of such 'search engines'?
Will proper search engines penalise your site if you are listed?
Will users get confused if when searching for a subject they are first drawn to the SEfFB site first?
One particular site which has indexed a lot of my content is one which claims to be a 'board reader'. I thought this was a good idea at first but now I'm not too sure.
My site ranks well in G for keywords for standard info pages but not for forum pages. I have done quite a bit of seo on the forum, G indexes regularily, and yet the pages do not rank well.
Should I block these search engines for forums and boards?
[edited by: Frank_Rizzo at 10:37 am (utc) on Nov. 3, 2008]
There is not much info on this particular bot I whitelisted and yet it is well established.
What is the consensus on these types of bots? Do they actually harm your ranking in G?
Note that this particular bot does not duplicate full message content - it only displays summary text and stats on posts and posters. Whilst it looks safe I wonder if there is some kind of penalty going on.
Actually, though, it seems unlikely that a short snippet would displace a lengthy thread - it's hard to imagine that being seen as dupe content.
Are these other sites sending you worthwhile traffic? If not, you could block their bots and request that any past content be removed.