homepage Welcome to WebmasterWorld Guest from 54.166.122.86
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
unister-bot
keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4353632 posted 11:31 pm on Aug 19, 2011 (gmt 0)


62.141.56.***
rDNS: ns.uni24032.keymachine.de

unister-bot (Mozilla/5.0 compatible; crawler@unister-gmbh.de)

robots.txt: yes

 

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4353632 posted 7:32 pm on Aug 20, 2011 (gmt 0)

Anything keyweb (ie keymachine.de) is blocked as far as I'm concerned. A real barrel of trouble.

Pfui

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4353632 posted 3:14 am on Nov 5, 2011 (gmt 0)

Agreed, dstiles. keymachine.de's been bad for years and years.

Note UA changes re caps and hyphen:

UnisterBot (Mozilla/5.0 compatible; crawler@unister-gmbh.de)

Hailed from:

ns.uni30216.keymachine.de [projecthoneypot.org...]
ns.km37033.keymachine.de [projecthoneypot.org...]

robots.txt? Yes BUT always immediately ignored.

Also, unister-gmbh.de (also keymachine.de-connected, surprise-surprise) is less than stellar. [robtex.com...]

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4353632 posted 9:41 pm on Nov 5, 2011 (gmt 0)

The bit I like in the robtex report is, "Trustworthiness, vendor reliability, privacy and child safety of this site is very poor". Well, not "like" exactly...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved