Forum Moderators: phranque

Message Too Old, No Replies

Possible to generally detect (good) bots?

         

mikomido

6:49 pm on Sep 1, 2007 (gmt 0)



I have noticed that 100% of the good bots use "LinkWalker/3.4" or something, instead of "Mozilla/4 (compatible; fdkfdfldf...)". Does this mean I can safely check for a (...) block to determine a bot?

mikomido

8:47 am on Sep 4, 2007 (gmt 0)



Are you stunned by my discovery?

Quadrille

5:35 pm on Sep 4, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No,

Stunned by the sheer number of threads you start with little or no logic to them.

You use Adwords, but complain about Adsense, you bash Google, but obviously use it all the time.

It's hard to know what you really want - other than attention :)

But if I've misunderstood, and your cries for help are genuine, maybe you could rephrase?

mikomido

12:49 am on Sep 5, 2007 (gmt 0)



Quadrille: I'm certainly not here to troll or waste my own or your time. I have genuine issues.

Anyway... what I meant is that browsers seem to use a "Mozilla/4 (compatible; blabla; blabla)" format, while bots use simply "SomeBot 1.2" without the "(...)" block. So this should spare me from having to sniff for certain string and just assume that any UA containing "(...)" is not a bot an vice versa.

No? Have I missed something?

PS: Just talking about god bots, naturally.

John_Blake

12:11 pm on Sep 5, 2007 (gmt 0)

10+ Year Member



What do you cal a good bot, anyway? Can anybody give me the lowdown on that?

Reno

12:39 pm on Sep 5, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What do you call a good bot

Other than Googlebot, Slurp, MSNBot, and Ask, are there any bots that do us any real good? To my eyes, they mostly use up bandwidth, so as much as possible, I block ALL the rest.

......................

Samizdata

1:25 pm on Sep 5, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have genuine issues

In my experience most are easily solved using the WebmasterWorld search.