Forum Moderators: coopster

Message Too Old, No Replies

Do Bots accept cookies?

general enquire on how bots work

         

Baruch Menachem

7:45 pm on Jan 24, 2009 (gmt 0)

10+ Year Member



I have been reading a lot of interesting stuff on site security. I was wondering if when you seen malicious behavior that can only be done by a bot, if you could give the bot an 86 cookie that when it visits your site again it would get a 404 error or something similar.

I was thinking if you saw things like long input strings into short input fields, javascript entries, etc, you could just find a way to tell the bot to go away.

From what I read, they like to visit your site often.

janharders

7:55 pm on Jan 24, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



no, bot's generally don't accept cookies (that is, most do not), they can however be instructed to accept them, so you cannot rely on them not accepting cookies nor them accepting cookies. sorry. for acl-thingies, I'd go for the IP. Most bots, especially the ones who run amok on your site without checking robots.txt aren't coming from dynamic IPs in my experience, but are running on dedicated servers or at universities and thus can easily be blacklisted by IP.

Rosalind

8:12 pm on Jan 24, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Although bots can be programmed to mimic human behaviour, it's futile to attempt to keep them out by giving them cookies. First of all you need to be able to identify them as non-human with a certain degree of accuracy. Look at the user-agent string and the IP, but most of all look for unusual behaviour like following hidden links, filling in hidden form fields, or eating through your bandwidth too quickly.

Look in to Project Honeypot. Their main focus is preventing email harvesters, but they're starting to tackle comment spammers as well now.

Baruch Menachem

9:12 pm on Jan 24, 2009 (gmt 0)

10+ Year Member



Ok, where is the best place to put a hidden form field so that it causes the most annoyance to the bot?

Is there much overhead to a hidden form field? does it slow down the legitimate user much?

eeek

4:58 am on Jan 25, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ok, where is the best place to put a hidden form field so that it causes the most annoyance to the bot?

Why would a hidden field bother a bot?

penders

5:22 pm on Jan 25, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I guess there's two kinds of robot activity to block.... There's blocking (nasty) robots from your site entirely, perhaps to avoid wasting unnecessary bandwidth or harvesting your content and then there's preventing robots (any kind of robots) from posting on your forms. Preventing robots from posting on your forms is generally the 'security' hole you need to plug.

This long thread has a lot of useful tips on the subject:
Frustrated with Spambots Coming In through Webmail Forms [webmasterworld.com]