Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: open
Googlebot didn't come back for ages so I submitted it yesterday.
Today I got in my logs:
crawl1.googlebot.com ¦ date ¦ GET /robots.txt HTTP/1.0
crawl1.googlebot.com ¦ date ¦ GET / HTTP/1.0 ¦ 304
does this mean that she is happy now or as I suspect, she is raising her lip to the site?
It is an old site that I've struggled to get the client to allow me to update for 3 years (i know :o )
Any thoughts - the site has a PR 4.
Secondly it asked for the default page on the root, and it got given a 304 which means "it hasn't changed since the last time you saw it". Incidentally that was one of the 216.* bots (aka "fresh" bot) which might explain the "has it changed" request rather than just give me the content.
On the plus side it does know your site exists at the moment but on the downside its not the deepcrawler (64.*) and as I'm not an expert on such things I couldn't say if that means you will be in the next index or not - although my gut feeling says "yes"...
Incidentally that was one of the 216.* bots (aka "fresh" bot) which might explain the "has it changed" request rather than just give me the content.
On the plus side it does know your site exists at the moment but on the downside its not the deepcrawler (64.*)
Actually I believe you have those reversed. Googlebot hits from 216.* are the deep crawler; those from 64.* are the freshbot.
Perhaps they do sometimes run a freshbot from that IP range. In general though it's thought that 64.* means freshbot.
Aha! So if that second line has a "200" instead of the "304", it means that the page has changed?
Basically that's right, as long as your server is supporting the "If-Modified-Since" header. A 200 response is the server just saying "ok, here's your document." A 304 means the requestor sent an "If-Modified-Since" request, and the server reponse was "it hasn't changed," so the document wasn't actually sent.
If your server isn't set up to support that, you'll only see 200s (or some other response for other situations), and never see a 304.
A related thread: [webmasterworld.com...]