Forum Moderators: open
Googlebot does (?) can (?) will always (?) simply send an
"If-Modified-Since" header to my site's server, about a specific page.
If the content has not changed since the Last-Modified date/time that Googlbot recorded/cached for the page, the server sends a 304 header-only back to Googlebot, and Googlebot simply tells the accordant document "barrel" to keep the cached version?
If the content _has changed, the server instead sends the "new" page, with a 200 header?
I'm sure I am over simplifiying the above synopsis, but are there any members with "tried and true" experiences?
I ask because I'm noticing Google's *still not finding my new content...
Log files tell me Googlebot calls for our default.htm
about once a day, but nothing else, regardless of new content added (in the root directory, for "ease of discovery"). So, in light of what I've read in these forums, I updated this page and now have a Last Modified of 10/1/03. I also created links to the new files on this page.
I'm wondering if I now the server shows a "new" Last-Modified date, will this prompt Googlebot (if I have the process right) to actually re-crawl the page, and find the new files via the links I put there?
Yes, it does support last-modified and if-modified-since but seems to recheck first exactly 50 days after the files modification date.
Thats ok for static pages, but for dynamic content it's useless.
Check your page with the cachability engine [ircache.net...]
You have to make real changes to the page(s). Changes in dynamically generated content won't help.
I've made changes, but our server doesn't return Last Modified info; additionally, I've uploaded new pages, and linked to them off pages at the first (top) level. Googlebot's not crawling them, and curiously the old pages that point to the new pages are returning no Last Modified
headers either - is that the problem, you think, Arnett?
