LinkTiger

[tangor]

Reportedly a broken link checker. One can try free for 15 days or pay for continued use. HOWEVER, I never contracted or even tried it, Yet for over a week they hammered my site unrelentingly---and since I have no broken links---hit every page and image on my site, bloating my raw log by nearly 20%! So ... 24 hours ago LinkTiger got fed a large fist full of 403s.

Chuckles ... just got an EMAIL from LinkTiger complaining their link checker had been unable to connect, provided instructions for me to log in on their site and make any corrections, or to alternatively determine if my site was down ...

I don't care who they are, their Link checking is egregious and annoying. However, their email also included some helpful material:

The IP addresses of our crawlers are:
207.244.68.67
207.244.75.68
207.244.75.161
207.244.96.112
207.244.96.142
207.244.97.160
207.244.103.103
207.244.103.130
207.244.112.204
207.244.112.219

Our User-agent is: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.4 (KHTML, like Gecko) Chrome/22.0.1229.79 Safari/537.4 LinkTiger 2.0

Robots.txt NO
BTW, LinkTiger does NOT appear in the UA at all times. Just a note in that regard.

Also noted that the email IP was NOT in that range, sourced from 167. Leaseweb-usa-wdc

[not2easy]

207.244.64.0 - 207.244.127.255 is Leaseweb afaik
207.244.64.0/18

[tangor]

The few other leaseweb vistors (sans the ones provided by LinkTiger) have been largely human and expected human behavior ... Meanwhile, I will keep an eye on them in the future!

[lucy24]

207.244.64.0 - 207.244.127.255 is Leaseweb afaik

Yes, and a quick look at logs reveals that almost all visits from this /18 are robots sending a root referer--that is, requesting /dir/subdir/pagename giving / as referer. That's enough to get them blocked in and of itself, because my links don't work that way.

The w3 link checker honors robots.txt, and happily it uses an exact-to-the-last-digit IP.

[dstiles]

Also, the UA is Windows XP, which has been obsolete for several years and banned on my sites, as is all (that I can find) Leaseweb.

[tangor]

These guys just won't give up!

I've had three more emails complaining they can't check for broken links AND SEEM TO BELIEVE I set it up in the first place.

I did not.

Vancouver, BC, even provides street address et al...

I can either laugh or get really irritated, or I can wait for their 15 day free trial to elapse and they figure it out on their own, or do the traditional nuking site level and filter then out in my email.

Dang persistent!