homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: DixonJones & mademetop

Website Analytics - Tracking and Logging Forum

Link Checker Advice Please
Need to filter by url for links not broken yet, but will be soon.

5+ Year Member

Msg#: 3173941 posted 7:41 pm on Nov 30, 2006 (gmt 0)

I'm hoping someone can help me find a Link Checker that will apply to my situation.

I work on a site with about 30,000 pages and several thousand links that are about to break due to an upgrade. These links all begin with a common IP address in the url to a document management system followed by a query string to the specific documents. This system will soon be completely overhauled, so all the links on our site to documents will break.

I am looking for a Link Checker that will let me filter for this IP address and catch all the links that begin with it, BEFORE they actually break.

Ideally, I would also like to generate a report where I can sort these links, so I can separate and distribute them to the various program areas in our agency. I would like to have the report specify what folders these links came from and let me sort by the folder.

Does anyone know if something like this exists? I appreciate any ideas. Thanks.



WebmasterWorld Senior Member 10+ Year Member

Msg#: 3173941 posted 9:56 pm on Dec 2, 2006 (gmt 0)

Wow. What a job.

In the past I have used LinkBot to do exactly this. It's now owned by Watchfire but there are older shareware versions out there. What you need is extensive but still low-level enough to be within the capabilities of shareware versions.


5+ Year Member

Msg#: 3173941 posted 4:47 pm on Dec 4, 2006 (gmt 0)

Thanks cgrantski! I am looking for a shareware copy now and will give it a try.

In the meantime, I have been trying Xenu and am having some luck with that. Its report feature doesn't seem to be too configurable, but by chance it seems like it might work. This is because Xenu's report has a section on redirects. It tells what pages the urls hitting the redirects are coming from. It just happens that the address of the links I'm dealing with all hit a redirect because of the way the application logs in the user. The majority of the redirect report was on these document management application pages that I'm trying to track. So I may be able to use that and just copy the section on redirects, and delete out the few that do not go to this document management app (we have a few other apps and pages that come up as redirects, but not too many).

However, this LinkBot sounds like a more smooth and configurable process so I'll definitely give it a try.

Thanks again.

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved