Forum Moderators: open

Message Too Old, No Replies

Site down during crawl.

Still getting freshbot daily

         

Powdork

6:05 am on Oct 10, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm working for a site whose server was down during the last deep crawl. It is still being crawled daily by the fresh bot. What will happen during and after the next update. My guess is that it may disappear during the update but then reappear after the next fresh listing and then pop in and out until the following update. If so are there any measures I can take to prevent this? Will it have any page rank? Will there be a lot of these cases due to the worldcom blackout as there were in May due to the Sprint blackout?

vitaplease

6:14 am on Oct 10, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Powdork,

this is my nightmare scenario. My feelings are with you.

Googleguy,

could you help us out with this, I know the spidering check has improved by checking back on consecutive days, but how many days can the server be down?

For example, if your Freshbot spider still finds the site two days later, just include the previous website's index and Pagerank.

Or tell us there is a way to safely host our site on two providers, or something to that effect.

Powdork

4:55 pm on Oct 10, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for your sympathy vitaplease.

Anyone have any answers?
It would be great if I could head this off before it happens.

Powdork

4:44 pm on Oct 11, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sorry to keep bumping this but I'm desperate here. The plot thickens. I've mentioned in other posts I'm working on two related sites. One site is PR 5 and is only linked to by one site which is pr6. The pr 6 site is the one down during the deep crawl. The pr 5 site has not been visited by the fresh bot as near as I can tell (don't have stats for this one but there's never been a fresh listing.) Can I assume that the pr 5 site will be totally gone for the entire period between the next update and the following one?

Again, what can be done?