Forum Moderators: phranque

Message Too Old, No Replies

Finding broken links...

finding broken link using a crawler

         

Sanenet

1:29 pm on May 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi all,

Here's the story. I'm the IA of a large corporation that has some 30 websites, group by different geographical area. (All are interlinked in different ways). All of the sites run of a proprietary CMS (in Cold Fusion), and generate pages on the fly. Since we now have soooooo many pages (some 17.000, last guestimate), added by several different people over the last year, I am looking for some sort of spider that will index all sites and return broken links.

I have some error catching in the code, giving me broken links, etc, but it's starting to turn into a nightmare - does anybody know of a good spider, or am I looking for the holy grail? :)

Thanks!

Macguru

1:41 pm on May 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi Sanenet,

Xenu was made just for that.

Hope this helps.

Sanenet

1:55 pm on May 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Looks good - will check it out. Thanks!