Planet13

msg:4343642 | 5:24 pm on Jul 25, 2011 (gmt 0) |
Have you been going through google webmaster tools and looking at the crawl errors? I have found LOTS of old broken links by going through there. It seems like over the last several months, google has really been digging up a lot of old links. If there are broken links to your site that GWT is NOT showing, then those broken links that GWT doesn't mention MIGHT NOT be worth worrying about... (hopefully others will chime in here). the other thing is to ask your web host if they have any software that will help you look through the logs and find the referring pages to your 404 page. So you find any time a 404 page was served, and you can look at what the referring page was. I think that will be better than trying to find something that would "scrape" the search indexes looking for broken links to your site, but maybe I am wrong.
|
g1smd

msg:4343680 | 6:49 pm on Jul 25, 2011 (gmt 0) |
You can get some of the data from WMT but there's an additional way. Create a separate Analytics profile and add the code for it ONLY to the 404 error page. You'll soon have a list of URLs that are being requested and how often.
|
Planet13

msg:4343681 | 6:54 pm on Jul 25, 2011 (gmt 0) |
| Create a separate Analytics profile and add the code for it ONLY to the 404 error page. |
| Great suggestion!
|
|