Forum Moderators: mack

Message Too Old, No Replies

Googlebot behavior!

Decreasing of crawl in mysite

         

super_duper

4:42 am on Sep 1, 2005 (gmt 0)

10+ Year Member



This is my first attempt on WebmasterWorld, so please help!
i have problem with googlebot/2.1, the number of bot has been decreasing since late July, apparently lost half of pages indexed in google. At almost the same time, Mozilla/5.0 has been hit very heavy. Do you think it is relevant? and any check lists to see if anything goes wrong? (mysite has PR8 and we have many fresh new pages add almost everyday)

mack

3:18 pm on Sep 1, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I can't see any relationship beween your drop in Googlebot visits and an increase in any other useragent. I can't see any reason for these factors to be related.

Most importaintly has your traffic from Google decreased. Over the past year or so Googlebot has been getting smarter and doesnt crawl all pages. It tends to work out an update cycle for a page and visit the page based in this data.

Mack.

super_duper

6:40 am on Sep 2, 2005 (gmt 0)

10+ Year Member



thanks Mack for the answer, but still we cannot find the reasons for the sudden drop of googlebot! and yes our traffic from google has been decreasing (around 50% from last monht).

mack

2:39 pm on Sep 2, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



The best thing you can do it try and figure out any changes you have made recently, then decide if those changes could have effected your rankings.

Then decide if it is in your best interests to roll back your site. If you have done nothing then your only real option is to try and ride it out, and hope you regain your rankings. This sort of thing does happen from time to time and more often than not sites fully recover.

Not very helpful i'm afraid but it's the best advice I can offer.

Mack.