Forum Moderators: Robert Charlton & goodroi
However, google seems ignoring all the changes, although it crawls the subdirectory and all the pages almost every day.
I checked my logs, and saw that the pages return a 200 code. But Google does not seem to fetch the file. Here is the typical log entry:
Http Code: 200 Date: Sep 15 19:35:55 Http Version: HTTP/1.1 Size in Bytes: 5
Referer: - Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
What strikes me is the "Size in Bytes: 5" part, since it tells that the file is just checked, and not fetched. Am I wrong?
My log shows thousands of such 200 and size 5 bytes crawls by google.
What does this mean? Does google just checking the file and leaving it alone? Is this 200 in fact a 304 (perhaps generated by php)?
How can I handle this problem? I.e., tell Googlebot that the pages are in fact modified?
Thanks in advance
Next, I would run the site through Xenu LinkSleuth and closely look at the error report that it generates.