Forum Moderators: open

Message Too Old, No Replies

My Server was down during the Deep Crawl

Any suggestions?

         

mtlion

4:14 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



It just so happens that I was in the middle of being switched to a new server along with the changing of IP number when the deep crawl took place.

I have notice that my inquiries(travel site) drop as well as my positioning with keywords.

Any ideas on how to recover from this?

creative craig

4:17 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have not seen the deepcrawl on all of my sites yet, so you maybe in luck!

Craig

mtlion

4:22 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



Craig,

Thanks for the quick response. How can I check my site to see if it crawled it?

creative craig

4:25 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you have access to your server logs?

If so you would see the IP information for Googlebot.

korkus2000

4:26 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The only way is to check your logs, so if your site was down then you will just have to wait and hope. I am just starting to see the deep crawler and I believe googlebot tries to reindex 404 sites later in the crawl. You may not be out.

mtlion

4:27 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



Yes I do have access to server logs. What is the IP number I should be looking for?

jpjones

4:28 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



You'll need access to your logs.

Look for "googlebot" in the user agent field, coming from IP Addresses in the 216.* range.

Do a search on the site for googlebot IP Ranges for more info.

HTH,
JP

creative craig

4:29 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Look for: 216.xxx at the start.

jilla

4:38 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



I see 200 at beginning. Is this deep crawl?

mtlion

5:27 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



I just finished checking my logs and I see that the following showed in my logs:

crawler11.googlebot.com - - [05/Mar/2003:00:21:01 -0500] "GET / HTTP/1.0" 200 9415 "-" "Googlebot/2.1 (+http://www.googlebot$

Was this the deep crawl?

fiestagirl

5:44 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



No, mtlion.

the deep crawl looks like this:
crawl2.googlebot.com

crawl not crawler.

mtlion

6:00 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



Thank you fiestagirl,

Has the deep crawl happen yet?

If not do you have an idea when it might happen?

Also what is the diffence between the FEB/ MAR crawl and the deep crawl?

By the way thank you to everybody that has responded. I am thankful for all the help!