Forum Moderators: open

Message Too Old, No Replies

Caching pages for googlebot

         

dual22

4:37 pm on Jul 27, 2004 (gmt 0)

10+ Year Member



Not sure if this is a correct forum for this kind of a question, I also tried searching for similar problem but was unable to find any.

I operate a very popular website, with over 200.000 unique daily visitors including spiders like googlebot.
The domain is operating on one but fairly fast server, unfortunately during some googlebot attacks the server is *almost dying* under load. The php scripts are very well optimized and I was thinking about some kind of other help for my server, and then php caching came to my mind. Caching is quite easy to do with software like jpcache.com but the main problem and the reason of this message is that I cannot cache content for my regular visitors.. Don't ask why, I just cannot do that because of my partners. Caching for googlebot alone seems kinda dangerous for me cause there are several parts of the website where content is changing with each browser refresh and I am scared that googlebot will treat this like a cloaking or something.. WHat do you think?

Sanenet

4:49 pm on Jul 27, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You could try contacting Google - if it's really hitting the site that hard, they should correct it.

[google.com...]

dual22

5:06 pm on Jul 27, 2004 (gmt 0)

10+ Year Member



I want it to spider my site :))) I dont think writing to them is a good idea anyway, still the server might be a little to weak for this website