This came from my raw log files: Test/0.1+libwww-perl/5.53 Seen this pop up a few times @ 22.214.171.124, just wondered if possibly a competitor is downloading, or someone running a test? Why does it show the path /test in the log files
1:48 pm on Apr 29, 2001 (gmt 0)
Probabaly someone testing a new crawler and has not named it yet - only an assumption.
Wait for those on the board to reply before you do anything about it!
4:16 pm on Apr 29, 2001 (gmt 0)
Address: 126.96.36.199 -> Name: adsl-138-89-85-23.nnj.adsl.bellatlantic.net The IP is sitting in a class C dedicated to dsl, it looks very home-grown.
6:40 pm on Apr 29, 2001 (gmt 0)
Being somewhat of a novice, what does " The IP is sitting in a class C dedicated to dsl, ... "
7:08 pm on Apr 29, 2001 (gmt 0)
IP addresses are four octet (byte) numbers that uniquely identify machines on the Internet, usually represented in decimal with octets separated by periods. For example, 192.168.12.1. A class C is where the first three bytes are the same. Since IP addresses are allocated in groups, one of the most common groups is to allocate 256 IP addresses together. Thus 192.168.12.anything would be a class C. So what he is saying is that all the addresses in this block of address are allocated for DSL connections to the Internet.
In this case, it was probably someone on their own DSL connection running some tool or spider they had written or acquired from somewhere.