homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Crawl errors and their impact on a site

5+ Year Member

Msg#: 3948794 posted 11:39 pm on Jul 8, 2009 (gmt 0)

Hey everyone

I have been checking our webmaster tools over the past week and drilling into URL's causing crawl errors - 404's, unreachable, etc.

There was a menu present on many pages which left out a "/" so that the link followed by browsers included the current working path and resulted in thousands of 404's. The site in question has around 2,000 pages of content and the links caused 5000 "not founds".

Would the above affect our rankings? Is there an "acceptable" amount of 404s that Google will tolerate?

Also, once you update the pages with the correct links, how long will it take Google to remove the 404 URLS from their site crawler error list?



5+ Year Member

Msg#: 3948794 posted 6:19 am on Jul 9, 2009 (gmt 0)

If the header response for your 404s is 200 (i.e. you have a custom 404 page that isn't correctly implemented) then this could be a problem.

I've seen a few sites that have removed good content pages from their index 'allocation' because they have hundreds of non-existent custom 404 pages taking up the space instead. Google doesn't seem to be able to weed these out if they are linked to from within and outside the site.

I've not had any experience with true 404s in that number.


5+ Year Member

Msg#: 3948794 posted 9:44 am on Jul 9, 2009 (gmt 0)

Hi fishfinger

The header response is 404, I remember using this header directive in the site code where necessary. The fact that WMT is showing pages as 404 would indicate that that is set up correctly.

My thinking was coming more from a point of Google applying some sort of site wide factor to its ranking algorithm based on the number of broken links / 404s on a site.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved