crobb305 - 10:06 pm on Mar 14, 2010 (gmt 0)
whether it's getting legacy backlinks changed or fixing website infrastructure problems
In January, I signed up for WMT, and discovered numerous 404s on Googlebot requests for index.html (example.com/index.html). Since WMT shows you the referring url leading to crawl errors, I examined those backlinks. NONE of them were linking to me using /index.html. EVERY backlink in the list linked correctly to my canonical. This lead me to set up rules to 301 redirect all requests for index.html to the canonical '/'. My first concern is why Googlebot was requesting index.html to being with, when the backlink did not exist using that format. My second concern now is that there may be a loss of PageRank from those links because of the 301 redirects. Googlebot should have been "seeing" the links correctly to begin with.