homepage Welcome to WebmasterWorld Guest from 54.145.182.50
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
NEW Spider??
Anybody seen this guy before
drbill

10+ Year Member



 
Msg#: 121 posted 10:52 pm on Sep 12, 2000 (gmt 0)

Hi,

I ran into an active little guy today..

Browser: Sqworm/2.9.15-ALPHA
Host:209.218.111.254

Ip leads back to @HOME network. Any suggestions?

Regards

Dr. Bill

 

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 121 posted 12:46 am on Sep 13, 2000 (gmt 0)

ATHM-209-218-xxx-254.Home.net
There has been some discussion about it here [webmasterworld.com].
What are it's spidering patterns? Does it hit your robot.txt?

drbill

10+ Year Member



 
Msg#: 121 posted 1:16 am on Sep 13, 2000 (gmt 0)

Littleman, Not seeing any robot.txt activity :( Just hitting page after page

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved