homepage Welcome to WebmasterWorld Guest from 54.166.65.9
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
test path
libwww-perl
bot_watcher




msg:404125
 1:26 pm on Apr 29, 2001 (gmt 0)

This came from my raw log files: Test/0.1+libwww-perl/5.53
Seen this pop up a few times @ 138.89.85.23, just wondered if possibly a competitor is downloading, or someone running a test? Why does it show the path /test in the log files

 

designfreak




msg:404126
 1:48 pm on Apr 29, 2001 (gmt 0)

Probabaly someone testing a new crawler and has not named it yet - only an assumption.

Wait for those on the board to reply before you do anything about it!

littleman




msg:404127
 4:16 pm on Apr 29, 2001 (gmt 0)

Address: 138.89.85.23 -> Name: adsl-138-89-85-23.nnj.adsl.bellatlantic.net
The IP is sitting in a class C dedicated to dsl, it looks very home-grown.

designfreak




msg:404128
 6:40 pm on Apr 29, 2001 (gmt 0)

Being somewhat of a novice, what does "
The IP is sitting in a class C dedicated to dsl, ... "

mean?

Xoc




msg:404129
 7:08 pm on Apr 29, 2001 (gmt 0)

IP addresses are four octet (byte) numbers that uniquely identify machines on the Internet, usually represented in decimal with octets separated by periods. For example, 192.168.12.1. A class C is where the first three bytes are the same. Since IP addresses are allocated in groups, one of the most common groups is to allocate 256 IP addresses together. Thus 192.168.12.anything would be a class C. So what he is saying is that all the addresses in this block of address are allocated for DSL connections to the Internet.

In this case, it was probably someone on their own DSL connection running some tool or spider they had written or acquired from somewhere.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved