homepage Welcome to WebmasterWorld Guest from 54.166.108.167
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Roaches
Interesting
eljefe3




msg:404743
 3:55 pm on Nov 29, 2000 (gmt 0)

avfwclient.sv.av.com - - [28/Nov/2000:16:01:08 -0500] "GET /robots.txt HTTP/1.0" 200 71 "" "roach.smo.av.com-1.0"

First time I've ever seen this critter. Only grabbed the index page.

 

mark_roach




msg:404744
 3:11 pm on Nov 30, 2000 (gmt 0)

It has also visited my site.

Bang goes my theory that it was my own personal AV spider :)

littleman




msg:404745
 12:13 am on Mar 15, 2001 (gmt 0)

It is using a Mozilla agent now ->
Mozilla/4.73 [en] (X11; U; OSF1 V4.0 alpha)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved