Welcome to WebmasterWorld Guest from 220.127.116.11
But it's time for more effective measures, so my question is, what should I do next? Captchas? Setting cookies on the submission guidelines page? Or are there any other solutions that have worked, and if so, which ones are best?
i had terrible problems with automated directory spam, one short term thing that works is to move the submission page, i think some spammers get the url and automate subs without going through the process you think they are.
you can log the ip of the submitter and ban further subs from that ip (this has drawbacks too in all kinds of ways)
i have now stretched the sub process over several pages, require cookies and have implimented an email confirmation system for them to confirm their entry by clicking the email link when they get it.
Simply: if they are eligible to be listed, they get in for free. If they are not, you charge the fee.
That way, you can get rich on other people's spam.
So I was trying to think of some way to tweak that idea to discourage that kind of behavior, and I think the trick is to decouple "paying" and "getting a listing".
Something like: always charge, for a listing or for no listing, WITH the option, at the reviewer's sole discretion, of foregoing the charge for really good sites OR for "almost good enough" sites.
So you'd have four "quality grades":
(1) Editor's pick site -- listed, charge waived. (top 10%, editor's sole option "Thanks for the website suggestion, which is a major contribution to the quality of my index; or which I've confirmed is a worthy non-profit/public-service/information-rich site")
(2) Normal commercial site -- listed and charged. ("OK, yeah, there's a site there, and it's OK, I suppose...")
(3) "almost good enough" site -- not listed, not charged -- a rare case, probably. (1% or so, editor's sole option: sites temporarily down, perhaps. "Come back again, if you like, when you've fixed the problem, but I'll REALLY charge you next time.")
(4) "spam" -- not listed but charged. ("Get lost in the howling wilderness, and may jackals suck the marrow out of your skull cavity while you can still scream.")
So nobody with a listing (class 2) is going to whine about the charge, because the option is to drop them down into no charge/no listing. Likewise, nobody with a listing is going to be in a position to complain about the charge, because they agreed to it up front ... and WITH the charge, it will be clear enough that there's nothing to be gained by a complaint -- your action would be to remove the listing and the charge. And people with no listing but a charge ... you've as good as told them they are bottom-feeding scum-sucking plague-feeding spammers and you really don't want to hear from them again.
Again, I have not tried this; I have not tried to build a commercial directory; and if anyone has tried anything like this, I'd be interested in hearing about it. Reality is always more complex than the simplistic models set up by people with no relevant experience.
Yahoo bypasses the argument by telling the submitter s/he's paying for consideration for a listing.
I guess I'll just have to think this one over.
Nice idea, billing spammers sounds really cool. Though I can see some disadvantages:
1) If you want to be sure that the person does not cancel the payment, you would have to get the money first, and refund it in case it is a site of class 1. Billing is easy, refunding is a bit more difficult, especially if you want it to be idiot-proof. One could use an online transaction service like paypal though, this way outsourcing the billing to someone else. :-)
2) Personally I would not submit any class 1 site to a directory like this. I don't trust people who want to bill me for nothing. Guessing I am not the only one who thinks like this, you most liekely will end up with a directory full of commercial sites.
3) I am no lawyer, but I guess a lot of classifications will end up at court, bacause submitters and editors have different opinions about site classification.
But these autosubmitters leave traces - they often use the same email-adress or name, for instance. So what I do is check for this email/name pattern in the script that processes the submission. If the pattern is there, the submission is not saved - but the text on the page is still "Thank you for the submission", so the autosubmitter can't tell that the submission didn't go through. This has worked well to remove some of the most blatant 5-10 spam submissions/day autosubmitters from my link review list.
I could check for IP as well, I guess, but I think these autosubmitters use a lot of IP adresses...
But, if the sites are 'unrelated' to my theme, this is fully explained before they add their site, so if they choose to ignore the rules, then they lose the cash and their listing. I find this will keep the spammers at bay, while showing a sense of quality and the fact it's a properly run business, rather than another 'free' directory to be taken advantage of.
Charging certainly makes people think twice before submitting. The spammers especially - if they know they'll get charged, it does stop them fast. Listings are removed on non compliance, it's harsh, but the only way to keep the crap at bay. Ofcourse, if a site owner does get really nasty, then a refund will be arranged only on careful analysis of the threat.
"Dear Sir, We find your directory not to be to our liking. Please remove us at once as we never asked to be listed"
Now, we know if someone has listed or not, and in the case above, we won't refund. Then you have the other removal request types:
"We will send the boyz round, if you don't remove us"
hmmmmmm, not to tricky to deal with. "Nope, you cannot have a refund kind sir"
Then we have the genuine, thick but kinda nice removal request.
Dear Mr Directory Owner,
Please kindly remove us from your directory, as you have charged us for a listing
Er, yeah, which was explained to you when you signed up for it. If you wanted it for free, then why enter your credit card details then? We get lots of these, as it seems people doooooo like a freebie, so we provide an excellent freebie - just in case they want one. Humans eh
We even get submissions, that then claim they didn't submit. Huh?
But will most likely remove them and refund, as some requests just aren't worth the hassle for the fee involved.
I suspect that requiring a backlink will filter out many upfront submitters, whereas the spammers will simply add the backlink -- ONLY until their link is added to the directory.
It's a tricky problem, because the directory is "pinned down" -- whatever you do in self-defence, the spammers have as long as it takes, to zero in on your current position.
This worked as I haven't had any more submissions to date. So a simple email can work wonders. After a while the spammers have to reveal themselves and there's always a pattern.