Forum Moderators: travelin cat
I'm serving a small website from my home Mac on Apache 1.3.33 and I'm looking for a fairly easily configurable, robots.txt compliant, link checking spider/bot to run over my site to check for broken URLs, that will compile or just run on Panther with minimal fuss. I've tried the w3c libwww bot, but it refuses to compile from tarball or cvs.
Bearing in mind I hate rude bots, it's very important I use one that's well behaved in order to prevent annoyance to others. Can anyone suggest a good'un?
Thanks,
Neil.
A search for either software name with "mac os x" appended should get you to the right pages. Good luck!
"BLT (Braxton's Link Tester) is a freeware link checking program for Mac OS X. It has a very small footprint (under 250KB!), but because of its extremely powerful foundation it really packs a punch. It can check sites both online and offline, create HTML and CSV reports, and can even be set up to check sites on a regular basis.
BLT checks all objects on web pages, not just images and clickable links. In addition, you get many options to help customize your link checking experience"