Forum Moderators: rogerd

Message Too Old, No Replies

Combatting blog comment-spam

Taking it to the next level...

         

zulu_dude

9:59 am on Jul 15, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



I run a popular blogging website, with several thousand members. In the beginning, comment spam was a minor issue as the site wasn't big enough to attract the attention of the spammers.

A few months ago, however, I noticed a marked increase in the amount of comment spam. As a concerned owner, I took steps to fight the spam, including blocking certain countries (via a geoIP database) and blocking individual IPs. That seemed to curb the flow of spam for a time, but in the last few weeks the spam seems to have got worse again.

What can I do to further bolster my defences against comment spam? I'd prefer to implement a solution on my own server than link into central spam databases.

Some options I have pondered:

Block by bad-word in the comment- I should have done this a while ago, but I'll search for certain bad words in the comment (like the V word) and block those comments.

Email confirmation- sending an email out for every comment and requiring commenters to confirm their email address. The only hassle with this is that it's a hassle! Might take a lot of the fun and spontaneity of commenting away.

Somehow harnessing the community spirit of the site to fight spam? Any other ideas would be most welcome!

lammert

11:05 pm on Jul 15, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



There are two ways to fight comment spam. Most people try to filter comment spam when the spammer enters his spam at your site. Your ideas are part of that. The second way is what I use. I have made my blog almost invisible for comment spammers. It is a stealth blog, totally indexed in the search engines, yet almost invisible for comment spammers.

To convert your blog in a stealth blog, you first need to identify how people find your blog. Many blog spammers find blogs through the search engines. Commonly used packages like WordPress have their own footprint. Specific words and phrases are the same on 99% of all installations and blog spammers search on these phrases in the search engines. This can be words from the normal pages, but for example also the login page to edit the blog.

To put your blog in stealth mode, change those words in something different. Also put a robots "noindex,follow" header on all pages that you don't want to be indexed by the search engines, like login and registration pages, default help pages etc.

I was amazed by the results. On average I have one spammer per two weeks left. And ironically most of those spammers reach my blog when searching on "captcha control" and "comment spam" because I have two posts on my blog about these two issues.

Rosalind

11:23 pm on Jul 15, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It's important to word your comment pages carefully, even when you don't use standard blog software. Try to find alternatives to phrases such as "leave a comment", for instance. That should help you cut down on the spam.

Another thing I find useful is to have a non-standard captcha. Those awful image captchas are everywhere, and they are, for the most part, crackable.

zulu_dude

9:45 am on Jul 20, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



Thanks for the responses. Unfortunately, stealth mode isn't an option for this site, as it is a blog hosting site, not my personal blog. As such, I have about 1500 users all promoting their blog, making it almost impossible to fly under the radar of the spammers!

I hadn't thought of doing a captcha code... will look into that.

For the short term, I think I'm just going to check comments content for blacklisted words and automatically add the IP address of the commenter to my ban list if a blacklisted word is found. There might be a little collateral damage, but that would be easily rectified.

I'm also going to disable any HTML code (including links) in comments.

zulu_dude

8:34 am on Jul 31, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



Just as an update to this thread:

Two weeks after implementing the automatic IP-banning for using blacklisted words, I've caught over 1500 spammer's IP addresses in my little spam trap. I've also prevented users from putting links in comments, although haven't automatically blocked them for doing this.

So far I've had about 2 spam comments in two weeks get through the net, compared to 20 a day prior to implementing this system. And no mistakenly banned IPs at all!

So it seems as if my site is winning the fight against spammers!

Rosalind

4:18 pm on Jul 31, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



That's a great result, Zulu Dude. However, expect to have to go back to this issue as your site increases in popularity. The more prominent your site becomes, the more spammers will target you deliberately.

AjiNIMC

6:25 pm on Aug 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



did captcha work for you? I have adviced our members to shuffle and try moderation. Moderate for a week and then again allow comments.

For me it worked. Try setting a captcha, it will help.

zulu_dude

1:06 pm on Aug 22, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



Hi AjiNIMC... I never actually implemented the captcha code, as the blacklisting by spam words trick worked well enough to not need anything else. At this stage, almost 3000 IPs caught and still no false alarms (that I'm aware of!).

I'm actually starting to think that the most effective part of the changes I made was to remove links in comments. Once spammers realise that there is no point in spamming the blogs, they'll soon leave (and indeed they have!).