Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
My site was down for 8 hours today (I've since purchased some back-up "insurance" in case this happens again).
Here's the deal:
The deep crawler (216.239....) hit my robots.txt and my index page about 10 mins. before I crashed...
Will I still be in the index next update? Is it going to drop any of my other pages that didn't get hit today?
Freshbot crawls me every day, but I know all my interior pages missed the deep crawl (at least for today) and only my main page got hit.
To me Google seems fairly tollerant on pages that are down at a particular instance. It may not get the updates, but it doesn't seem to drop pages simply because it couldn't get to them on the first attempt.
Reliable hosting is however invaluable. Suffer this fait a couple of times in a row and you maybe in trouble.
However, for a one time problem I don't think Google will care :)
While there's no way to predict what might happen, I wouldn't panic yet.
joined:Oct 19, 2002
If you donít see googlebot or the newer freshbot after a week or so you might possibly be out of the next index.