kolin

msg:3516060 | 11:50 am on Nov 29, 2007 (gmt 0) |
this is actually something i have done with one of my sites. if an error occurs, i serve up a specific 500/40x page and get the web application to instantly send me an error email, so i can quickly fix the problem. it's currently a horribly reactive method to sit and wait for problems to happen, but the most thorough testing will not get all issues within the stupidly small timescales us web developers are given. and it's better than somebody emailing in a 500 server error to somebody who then starts to panic. i'd rather it go straight to me who wont panic, and just get it fixed.
|
giggle

msg:3519869 | 3:42 am on Dec 4, 2007 (gmt 0) |
Now that's what I call timing! Yesterday I set up a 500;100 to catch ASP errors and give the user a soft bump should an error occur. I set up a new page that looked nice for the user but also sent an email and SMS'd me with details of the problem. Let's just say that I was busy last night sorting out some coding issues I would not have been aware of had this new page not been there. I kind of feel like I'm being both proactive (handing an error situation in a positive, controlled way) and reactive (in the sense that now I can now react quickly to errors and correct them). Well, that's my interpretation anyway. Does anyone know how I can catch the http status code (and any additional details) in ASP so that I can create one page to handle all the various situations. Thanks Mick
|
RonPK

msg:3520008 | 10:29 am on Dec 4, 2007 (gmt 0) |
One of my clients has an everchanging extranet that runs on PHP and MySQL. Error handling & reporting is a key feature of the system. All PHP and MySQL errors are reported by email to me, and the user gets to see a custom error page. I find that having a good error handling module also benefits development as it makes it easier to find the cause of errors.
|
g1smd

msg:3520108 | 1:27 pm on Dec 4, 2007 (gmt 0) |
It would be good to see a quick list of the sort of problems that had to be fixed, so that others don't make the same mistakes...
|
JS_Harris

msg:3520109 | 1:31 pm on Dec 4, 2007 (gmt 0) |
I've done this with my own servers, great post and a good idea for all webmasters to think about. I have some sites hosted with others however and I wish they would implement this too. They don't include the errors in their reporting either but my own tracking shows them. I'm all for this change.
|
souravamant

msg:3520122 | 2:11 pm on Dec 4, 2007 (gmt 0) |
Yes indeed, I run a very small blog and I have been using this for a while with great results.. Sourav
|
pageoneresults

msg:3520281 | 5:29 pm on Dec 4, 2007 (gmt 0) |
| It would be good to see a quick list of the sort of problems that had to be fixed, so that others don't make the same mistakes. |
| The list could be quite long and specific to the application. I've found the process of tracking 400 and 500 errors to be a very "eye-opening" experience and one that I would definitely recommend to all involved with development. Just think... Edward, I ran into an error yesterday while doing this... No problem, we've already addressed it and you should be good to go. Proactive is the way to go. They say for every one (01) error reported, there are nine (09) others that are not being reported. That should be enough incentive in itself to look into something like this. ;)
|
milanmk

msg:3520346 | 7:12 pm on Dec 4, 2007 (gmt 0) |
I would like to point one important part called error logging. I do have all the notification methods in place but I make sure to dump most of the client and server information relating to that error to an error log file, which is kept outside of root folder and secured by Apache directives. Many times it happened that the notification emails been deleted once the error has been rectified and then suddenly I found some related bug but do not have any supportive data to relate it to the previous error. Therefore, I think error logging is also crucial part that will allow you to inspect past errors and help you in rectifying future ones. Milan
|
klown

msg:3520634 | 2:48 am on Dec 5, 2007 (gmt 0) |
Great topic, for some reason I never thought to record the errors I was receiving. Anyhow I wrote a bit of PHP to email me info on my errors. The code should work on any site, you just need to change the email address and make a bit of a modification to your .htaccess file (adding on?errorcode=404 etc.). Hope this is useful for somebody. The script will email you: IP Error code and definition Browser version Date and Time Referrer Page Website the error occurred on <?php $referid=$_SERVER['HTTP_REFERER']; $url="http://".$_SERVER['HTTP_HOST']; if (getenv("HTTP_CLIENT_IP")) $ip = getenv("HTTP_CLIENT_IP"); else if(getenv("HTTP_X_FORWARDED_FOR")) $ip = getenv("HTTP_X_FORWARDED_FOR"); else if(getenv("REMOTE_ADDR")) $ip = getenv("REMOTE_ADDR"); else $ip = "UNKNOWN"; $datetime=date("r"); $browser=$_SERVER['HTTP_USER_AGENT'] ; $errorcode=$_GET['errorcode']; switch ($errorcode) { case 400: $definition="Bad Request"; break; case 500: $definition="Internal Server Error"; break; case 403 : $definition="Forbidden"; break; case 404: $definition="Not Found"; break; case 408: $definition="Request Timeout"; break; } $subject="$url Error $errorcode"; $body="URL: $url Error: $errorcode $definition Referer: $referid IP: $ip Browser: $browser Datetime: $datetime "; $email="youremail@domain.com"; mail ($email,$subject,$body); ?>
|
jdMorgan

msg:3520641 | 3:00 am on Dec 5, 2007 (gmt 0) |
I'd like to add a note of caution here, although I agree that the proactive approach has a lot of merit. When designing your notification and/or logging system, keep it simple. You want to minimize the dependencies of the error-handler. For example, if you have a problem with your PHP configuration which causes a serious problem running PHP code under certain circumstances, and you then try to use PHP to report or log that error, then you'll get knock-on errors, with a server error causing another server error, etc. So error handling --especially that for the 500-Server error-- should be kept as simple as possible. Jim
|
travelorama

msg:3521302 | 12:06 am on Dec 6, 2007 (gmt 0) |
Lots of great ideas here. How about logging errors off-site by serving visitors a tiny JS? Even if PHP went down, a plain HTML page could do the trick. Just my 2c
|
jgar

msg:3521792 | 6:03 pm on Dec 6, 2007 (gmt 0) |
OK, while were on the subject, how about tracking image-loading problems ... the page loads, but an image is not available - I would say this may be a fairly common error that for the user makes quite a difference, but maybe is a difficult error to track - we use ASP, any ideas?
|
giggle

msg:3522121 | 2:14 am on Dec 7, 2007 (gmt 0) |
JGar I recently set up a 404 that emails me when missing pages are encountered. A side effect of that is that I also get emails when pictures are missing. It doesn't redirect the page to the 404 page, the page works normally and I still receive the missing pictures email. Mick
|
denisl

msg:3522265 | 8:38 am on Dec 7, 2007 (gmt 0) |
I have got to say thanks to KLOWN above for that code to send email reports from my custom 404 pages - I have found this unbelievably useful. I added this to get the full the path of the page that was not found $path=$_SERVER['REQUEST_URI'];
|
Bewenched

msg:3522464 | 3:47 pm on Dec 7, 2007 (gmt 0) |
Giggle - in response to missing images. i have a nifty little script that makes sure the image is there, if not show a transparent gif. it's in VB script/asp if any one is interested pm me. The only problem with it is that it is case sensitive to the file name so if it's calling whatever.jpg and the file is really named WhatEver.jpg it will show the alternate image. I haven't found a work around for that yet.
|
jixi

msg:3524298 | 6:08 pm on Dec 10, 2007 (gmt 0) |
You could use crawlscore to identify the problems in the first place but's a good idea to log them going forward. hth.
|
|