Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Crawling rate Dropped in Google

         

ahdtravel

6:40 am on Aug 12, 2009 (gmt 0)

10+ Year Member



Hello Guys,

I have a Problem with one of my sites... The crawling in Google keeps getting low and low every single day... I have Try to find out what exactly is the problem but couldn't find any.... I have no "Clue" what is wrong with my website and I am totally "Lost". It would be great if any one of you guys can help me in solving for this problem. I have done everything in my power to fix and freshen up all errors.... It would be great if you guys can help me out with it.

Thank you
Kiran

tedster

5:55 pm on Aug 12, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If this happens every single day, then it sounds like Google has allocated that particular level of crawling as your site's "crawl budget". Crawl budgets are set using many factors, including the popularity of the site, the frequency of new content, the technical ability of the server to handle a given crawl rate, Google's own available computing cycles at the moment, and lots more.

What kind of problems does the current crawl rate cause for your site?

Yeoj

7:50 pm on Aug 13, 2009 (gmt 0)

10+ Year Member



I made my main site a lot faster (rewrote the backend and upgraded the server) and the crawl rate rocketed.