Forum Moderators: open

Message Too Old, No Replies

Is this a new search spider?

         

sculptex

5:54 pm on Nov 17, 2005 (gmt 0)

10+ Year Member



these IPs have been hitting my site since the beginning of the month

registered with bayarea.net

209.128.75.98-104
64.42.30.81-87

seem like search spiders to me?

any info appreciated

volatilegx

10:05 pm on Nov 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi sculptex and welcome to WebmasterWorld :)

I don't recall if I've seen these IP addresses. Can you tell me what the User Agent associated with them is?

sculptex

11:59 pm on Nov 17, 2005 (gmt 0)

10+ Year Member



no agent listed, sorry :(

ps. thanks for the welcome

sculptex

12:04 am on Nov 18, 2005 (gmt 0)

10+ Year Member



more info e.g.

Host: 64.42.30.82
Http Code: 302 Date: Nov 17 07:31:10 Http Version: HTTP/1.0 Size in Bytes: 27255
Referer: -
Agent: -

always accessing site root (/) and sometimes several hits from each IP.

sculptex

3:52 pm on Nov 18, 2005 (gmt 0)

10+ Year Member



A more complete list would be;

64.42.30.81-87
64.71.176.3-9
66.194.6.75-84
168.150.251.241-247
209.126.158.211=213
209.126.190.35-37
209.126.252.3-9
209.128.75.98-104
209.128.89.115-120
209.128.93.194-200
209.133.51.81-87
209.133.51.113-118
209.237.42.67-73

Bizarrely, none have shown any user agent except one instance only of

66.194.6.83

Mozilla/5.0 (compatible; Konqueror/3.1-rc2; i686 Linux; 20020202)

All since beginning of this month during night hours (here in UK).

DanA

4:00 pm on Nov 18, 2005 (gmt 0)

10+ Year Member



All do not come from the same place (3 different origins)
The last one comes from websense (fake user agent - 66.194.6... spider of a content filtering company, will come every day with 3 different user agents)

bull

5:11 pm on Nov 18, 2005 (gmt 0)

10+ Year Member



66.194.6.0 - 66.194.6.255 = WebSense
There are some threads about this one.

I have occasionally seen requests from 209.126.254.* w/o User-agent specified.

-----------

209.133.0.0 - 209.133.127.255 = AboveNet
Home of Bots like :
MSRBOT (209.133.64.*)
CosmixCrawler/0.1 (209.133.117.21 , .30 )
falcon/1.0 (209.133.117.22)

I have blocked that whole range

sculptex

12:44 pm on Nov 19, 2005 (gmt 0)

10+ Year Member



okay, thanks guys.