-- Search Engine Spider and User Agent Identification
---- HTTrack / Virgin Media
lucy24 - 1:26 am on Feb 26, 2012 (gmt 0)
I've always believed that a plain-Jane 403 served by the visitors own machine is most appropriate
But the 403 isn't served by the visitor's browser. It's served by, er, the site's server. Insert boilerplate about MSIE and 512K Exception. The browser itself only kicks in when there's an error involving external redirects. The server is no use there, because it has no memory and can't say "Uh, weren't you here just .0000001 seconds ago, and .0000001 seconds before that, and...?"
In addition, many of the shared hosts will automatically insert a custom 403 with advertising for their services
Ugh. Do they really? Yuk. I think mine only does that with the placeholder page.