homepage Welcome to WebmasterWorld Guest from 54.227.215.140
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
SearchSpider.com/1.1 24.90.240.54
jon80

10+ Year Member



 
Msg#: 2162 posted 3:10 am on Aug 6, 2003 (gmt 0)

Anyone come across this one?

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 2162 posted 10:06 pm on Aug 6, 2003 (gmt 0)

Your likely to see any thing from Road Runner :(

The bot is the SE address. There doesn't appear to be much there.

ServMe

10+ Year Member



 
Msg#: 2162 posted 9:09 am on Aug 7, 2003 (gmt 0)

I first noticed this spider on august 3rd, according to my logs doesn't even look for a robots.txt file.

Their site has no real info whatsoever, let alone regarding their spider, so I blocked it.

Finder

10+ Year Member



 
Msg#: 2162 posted 5:42 pm on Aug 8, 2003 (gmt 0)

It checked robots.txt on my site and didn't take anything else.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved