homepage Welcome to WebmasterWorld Guest from 54.226.136.179
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
fed.looksmart.com
Has anyone seen this one?
awoyo

10+ Year Member



 
Msg#: 569 posted 6:26 pm on Apr 18, 2001 (gmt 0)

Has anyone seen this one?

fed.looksmart.com, 207.138.42.247
Agent: Mozilla/4.5 [en] (Win95; I)
Referral: (None)

The IP block belongs to Global Crossing (NET-GBLX-8).

Jim

 

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 569 posted 6:54 pm on Apr 18, 2001 (gmt 0)

That is an odd one.
[fed.looksmart.com...] is a mirror of looksmart. There is very little evidence history of activity coming from this IP. Did it act like a spider or human?

awoyo

10+ Year Member



 
Msg#: 569 posted 7:40 pm on Apr 18, 2001 (gmt 0)

These are the only two entries in my log file for this guy. He came in, hit my index page (at the time I was calling it index.cgi) and left. This is the only file I have that's close to this size, and I did some editing on it this week which probably accounts for the discrepancy in file size here in the log entries. My cloak log shows that he would have been fed the file from my visitors directory which is 11K, but that's far from the size shown here. I'll be waiting up for him around 23:30 tonight. :)

fed.looksmart.com - - [16/Apr/2001:23:29:58 -0700] "HEAD / HTTP/1.0" 200 0 www.my-domain.com "-" "Mozilla/4.5 [en] (Win95; I)" "-" 29615

fed.looksmart.com - - [17/Apr/2001:23:57:14 -0700] "HEAD / HTTP/1.0" 200 0 www.my-domain.com "-" "Mozilla/4.5 [en] (Win95; I)" "-" 28619

Jim

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 569 posted 8:30 pm on Apr 18, 2001 (gmt 0)

okay, this is pure speculation, but it looks like a link verification bot. Perhaps it is a (new?) bot LS uses to make sure it's directory is current?

awoyo

10+ Year Member



 
Msg#: 569 posted 1:07 pm on Apr 19, 2001 (gmt 0)

> Link verification bot

I had the smae thoughts.

He came again last night. Only this time he took 26403 bytes and I don't have a file that size on the site. It looks like he's coming in, getting an "OK", and leaving.

fed.looksmart.com, 207.138.42.247
Agent: Mozilla/4.5 [en] (Win95; I)
Thu Apr 19 00:40:05 2001

Jim

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved