Is it possible to tell googlebot that he doesn't have to visit since the webpages has not changed? This would save a lot of bandwidth....
Leif
mack
9:19 pm on Mar 16, 2003 (gmt 0)
I remember reading a thread on here. It was about a server header that tells robots if content has been changed. If there is no changes to content then this instructs the bit that it does not have to re index.
Does setting the Expires header to now + 6 months make any difference? Does that make Google visit less often?
Leif
mack
1:03 pm on Mar 17, 2003 (gmt 0)
I have very little experience of it because I dont have much opertunty to work server-side. From what I understand it is a server header that instructs the bot exactly what pages have changes since the bot last accessed the server. If pages have not changed that the bot will not index them. The header would have to be installed and/or set up by your server administrator. If you are using a hosting company this will very often be out-with your control.
