Curiosity about Ask Jeeves

Forum Moderators: open

Message Too Old, No Replies

Curiosity about Ask Jeeves

How Ask Jeeves agent works

Tegame

2:58 pm on Nov 25, 2002 (gmt 0)

Hello,

I'm curious to understand if the following HTTP User Agent: Mozilla/2.0 (compatible; Ask Jeeves), is created by search engine of Ask Jeeves or by Ask Jeeves tool bar.

thanks in advance for any help on this.

Giulio

carfac

4:23 pm on Nov 25, 2002 (gmt 0)

Hello Tegame:

Welcome to the forum!

I have seen this UA a lot.... and, for me, it always traces back to Ask Jeeves. Hard to tell for sure, you did not leave in the IP... and, to be honest, I do not know what (if anything) the Jeeves toolbar adds to a UA string.

I have found this UA to NOT follow robots.txt, and (at least on my machine( Jeeves keeps getting itself banned because he cannot stay out of where he is asked not to go.

When in doubt, you can check arin at:

[arin.net...]

for US addresses. If it is not a US address, try RIPE for Europe

[ripe.net...]

and APNIC for Asia and Oceana

[apnic.net...]

There are some otheres, a Carribean nic for instance.... but those are the biggies.

dave

barrykilbycouk

5:29 pm on Nov 26, 2002 (gmt 0)

AS far as im aware the "HTTP User Agent" ts the tag the browser leaves behind, not any kind of tool bar etc. I would say that it was ask jeeves spidering your site. I have checked my stats and it is lised as the same unix OS everytime.. shurely if it a user the os would differ each time? :)

jeremy goodrich

6:27 pm on Nov 26, 2002 (gmt 0)

Welcome to WebmasterWorld [webmasterworld.com], Tegame.

There's more than enough info here to keep anybody reading for months without stopping, and without rereading the same posts :)

The different *NIC's are a great place to start when looking to get information on the various search engine spiders, I highly recommend them.

ARin.net is a great one, since many spiders originate in the US from arin assigned IP addresses.

You might also use Sam Spade [samspade.org] as there are many online tools there for network stuff.

When in doubt, you can also use the server header checker tool at Search Engine World [searchengineworld.com] (just scroll down on the index for the 'tools section'.

Hope that helps, and enjoy the forums!