Forum Moderators: open

Message Too Old, No Replies

German National Research

spider is new to me, you?

         

kwasher

1:44 pm on Jun 23, 2004 (gmt 0)

10+ Year Member



Search results for: 192.129.3.46

German National Research Network DFN-NETS-5 (NET-192-129-1-0-1)
192.129.1.0 - 192.129.31.255
Polytechnical Institute of Bucharest PIB-SNET1 (NET-192-129-3-0-1)
192.129.3.0 - 192.129.3.255

volatilegx

2:46 pm on Jun 23, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you have the complete User Agent?

What kind of behaviour is the spider exhibiting? Does it access and obey robots.txt?

kwasher

3:26 pm on Jun 23, 2004 (gmt 0)

10+ Year Member



Im not very proficient at log examination, all I have is a number of emails that look like this-

Date: 06-23-2004[04:19:10]
User request for: [****xxxxx.net...] was not found!
IP address: 192.129.3.46
Browser: MSIE 6.0
Referred by: n/a

Error Code: 404

--

It does appear to follow the robots.txt, as my automatic badbotbanning did not ban it.

volatilegx

4:31 pm on Jun 23, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The German National Research Network appears to be a network of German-speaking universities. This spider originates on an IP assigned to that network, but I doubt it is officially run by that network. Most likely a research bot of some kind.