jo3y - 5:17 pm on Oct 12, 2012 (gmt 0)

Hi everyone,

I am having a crawl error issue with Google Webmaster Tools. I have researched, tested, etc. etc. and I can not find the problem. It is reporting over 1000 crawl errors and climbing.

Google Webmaster Tools reports tons of pages that do not exist due to a wrong path. When I go to the page listed as having the bad link everything looks correct. I even went as far as making all the links on the entire site absolute links(full URL), and I still get the errors. Here is what it's reporting:

Pages like this that do not exist(wrong path).

http://www.example.com/details/B7427/parts/5/images/Claimer%202011%20Front.pdf

The proper directory for that file is:

http://www.example.com/images/Claimer%202011%20Front.pdf

So it seems to be linking to it like it's a relative path because here is the URL that is reporting to have the bad link:

http://www.example.com/details/B7427/parts/5/Ford.html

All the links on the page above(page that allegedly has the bad links) are absolute path links. I am at a loss.

The other possibility is all my pages run through index.php with GET variables directing the content, so I have rewrite rules in place for more user friendly URLs. Could my rewrite rules be the cause of this? Here are my htaccess rewrite rules:



RewriteEngine On
RewriteRule ^([^/]*)\.html$ /index.php?content=$1 [L]
RewriteRule ^([^/]*)/([^/]*)\.html$ /index.php?content=$1&manufacturer=$2 [L]
RewriteRule ^([^/]*)/([^/]*)/machine%20shop/\.html$ /index.php?content=$1&service=$2 [L]
RewriteRule ^([^/]*)/([^/]*)/([^/]*)\.html$ /index.php?content=$1&product=$2&service=$3 [L]
RewriteRule ^([^/]*)/([^/]*)/([^/]*)/([^/]*)\.html$ /index.php?content=$1&MID=$2&category=$3&manufacturer=$4 [L]
RewriteRule ^([^/]*)/([^/]*)/([^/]*)/([^/]*)/([^/]*)\.html$ /index.php?content=$1&part=$2&category=$3&MID=$4&manufacturer=$5 [L]

Thank you guys in advance for any advice/assistance on this issue. Even though crawl errors don't play too big of a role in a site's ranking and performance, this seems like something is wrong and needs to be fixed.

Thanks again,

-Joey

[edited by: Robert_Charlton at 7:51 pm (utc) on Oct 12, 2012]
[edit reason] examplified domain [/edit]