homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Understanding the "Crawl Rate" Explanation in WMT

5+ Year Member

Msg#: 3811008 posted 5:35 am on Dec 19, 2008 (gmt 0)


This is regarding the "Crawl Rate" functionality of Google webmaster tools. They have explained it as follows

"The crawl rate affects the speed of Googlebot's requests during the crawl process. It has no effect on how often Googlebot crawls your site. Google determines the recommended rate based on the number of pages in your site."

My Question :

How do you differentiate between "speed of requests" and "how often Googlebot crawls the site". If the speed of requests increases that don't you think that my website is getting crawled pretty often?

Pls help me out with is.




Msg#: 3811008 posted 6:05 am on Dec 19, 2008 (gmt 0)

"Speed of requests" refers to the speed of the crawl--i.e., the interval between each page request during a crawl. In some cases, limiting the crawl speed might be desirable to avoid overloading a busy server. In other words (to use purely a hypothetical example), a weekly crawl might take 30 minutes or an hour, depending on the chosen crawl speed, but it would occur once a week in either case.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved