homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Code, Content, and Presentation / HTML
Forum Library, Charter, Moderators: incrediBILL

HTML Forum

Custom error page?
A questino about custom error pages?

 3:54 pm on Jan 18, 2001 (gmt 0)


I have modified my 404 not ofund page to return a custom erro page (1.5k in size).

My question is now: will all those spiders/bots realise this page is an error page, or will they happily index it as well?

I know about the robot exclusion std. and the possibility I have with the robots meta tag.




 3:59 pm on Jan 18, 2001 (gmt 0)

If you're doing it through htaccess, the server will return a 404 status along with the error page and the spiders won't (shouldn't!) index it.


 10:44 pm on Jan 18, 2001 (gmt 0)

That's the way things have been working for me for quite some time -- thank goodness, since on some sites the custom error page is a copy of the index page. Wouldn't want to get that dropped as a duplicate!


 11:04 pm on Jan 18, 2001 (gmt 0)

While on the topic, I added javascript to write the referrer to a text block on a form on the 404 custom page. All the user has to do is click the "submit" button and it'll send the url of the page where the bad link is coded. You'll be surprised/shocked at how many you'll get.


 2:50 am on Jan 20, 2001 (gmt 0)

I found a free script: Checklinks 1.0.1 It's very customizavle, as far as what you want it to check, report, ignore, etc. (I have it set to ignore my javascript links... I check those by hand whenever I change a page or create a new one...)

It runs from the command line, and outputs results in the telnet window, and I've now weeded out all my in-site 404s. Right now the only 404s I'm getting are people (like me) mi-typing URLs.

checklinks info & download:

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / HTML
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved