homepage Welcome to WebmasterWorld Guest from 54.204.141.129
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
unister-bot
keyplyr




msg:4353634
 11:31 pm on Aug 19, 2011 (gmt 0)


62.141.56.***
rDNS: ns.uni24032.keymachine.de

unister-bot (Mozilla/5.0 compatible; crawler@unister-gmbh.de)

robots.txt: yes

 

dstiles




msg:4353852
 7:32 pm on Aug 20, 2011 (gmt 0)

Anything keyweb (ie keymachine.de) is blocked as far as I'm concerned. A real barrel of trouble.

Pfui




msg:4383737
 3:14 am on Nov 5, 2011 (gmt 0)

Agreed, dstiles. keymachine.de's been bad for years and years.

Note UA changes re caps and hyphen:

UnisterBot (Mozilla/5.0 compatible; crawler@unister-gmbh.de)

Hailed from:

ns.uni30216.keymachine.de [projecthoneypot.org...]
ns.km37033.keymachine.de [projecthoneypot.org...]

robots.txt? Yes BUT always immediately ignored.

Also, unister-gmbh.de (also keymachine.de-connected, surprise-surprise) is less than stellar. [robtex.com...]

dstiles




msg:4383897
 9:41 pm on Nov 5, 2011 (gmt 0)

The bit I like in the robtex report is, "Trustworthiness, vendor reliability, privacy and child safety of this site is very poor". Well, not "like" exactly...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved