-- Search Engine Spider and User Agent Identification
---- of pipl and robots
lucy24 - 4:41 am on Mar 10, 2012 (gmt 0)
Oh, gosh, I once met an absolutely horrendous robot from that neighborhood. 159.253.145.nn. It's in my notes as no robots.txt, 400 requests in 50 sec, most links wrong
Notes also say (1) 159.253.128-159 softlayer/Netherlands and (2) 253.145.128-191 (22.214.171.124/26) which is the form I've blocked them in, though I could perfectly well have gone to the /19 form.
January 1, so it probably rates a mention next door in At Home With the Robots [webmasterworld.com] :: shuffling papers :: Yup. It's the one I flagged as "stupid robot" because of its utter incompetence when it came to parsing <a ...> tags:
With 394 hits in 50 seconds I would put it at the top of the ### list ... if it weren't for its mind-boggling, over-the-top, jaw-dropping, have-to-see-it-to-believe-it stupidity.