homepage Welcome to WebmasterWorld Guest from 54.161.166.171
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
whoare.us who who, who who!
we know who you are too!
incrediBILL




msg:4384165
 8:26 pm on Nov 6, 2011 (gmt 0)

whoare.us is yet another domain intel site, yawn.

This one crawled out from under a rock at the following:

IP: 46.4.67.131

USER AGENT: blank, nada, zilch a whole "", bounced right off the firewall

HOST: hetzner.de

IP RANGE: 46.4.67.128 - 46.4.67.191

 

lucy24




msg:4384209
 9:49 pm on Nov 6, 2011 (gmt 0)

Good heavens. I've had 46.4 blocked for ages. It's more trouble than it's worth to weed out the "no skin off my nose" robots from the "I don't like your face" ones ;)

I think they actually cover 46.4-5 but I once met a human at 46.5.something.

You're having fun coming up with thread titles, aren't you.

dstiles




msg:4384222
 10:43 pm on Nov 6, 2011 (gmt 0)

46.5.0.0/16 is KabelBW - nominally broadband so I don't block it.

I have 46.5.21.49 blocked for multiple-UA scrapes but otherwise I have nothing adverse listed for this range.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved