Forum Moderators: Robert Charlton & goodroi
ight now they are reporting as 404 on my site things like "123456/ad_slot_top_main" which are strings used by the Google adserver and embedded in javascript. Certainly not urls. Just braindead crawl behavior.
The lower section disappeared at the same time that a message about "crawling suspended because robots.txt not accessible" appeared (several months ago). However, robots.txt was and is accessible and Google was and is fetching it, and was and is still also crawling the site!
They changed it a while ago such that if there are no errors, that particular error type doesn't show up.
I don't think I've ever seen a site with no 404 errors.