homepage Welcome to WebmasterWorld Guest from 54.198.140.182
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
SearchSpider.com/1.1 24.90.240.54
jon80




msg:397856
 3:10 am on Aug 6, 2003 (gmt 0)

Anyone come across this one?

 

wilderness




msg:397857
 10:06 pm on Aug 6, 2003 (gmt 0)

Your likely to see any thing from Road Runner :(

The bot is the SE address. There doesn't appear to be much there.

ServMe




msg:397858
 9:09 am on Aug 7, 2003 (gmt 0)

I first noticed this spider on august 3rd, according to my logs doesn't even look for a robots.txt file.

Their site has no real info whatsoever, let alone regarding their spider, so I blocked it.

Finder




msg:397859
 5:42 pm on Aug 8, 2003 (gmt 0)

It checked robots.txt on my site and didn't take anything else.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved