Welcome to WebmasterWorld Guest from 22.214.171.124
The custom crawl rate option allows you to provide Googlebot insight to the maximum number of requests per second and the number of seconds between requests that you feel are best for your environment...
Googlebot determines the range of crawl rate values you'll have available in Webmaster Tools. This is based on our understanding of your server's capabilities. This range may vary from one site to another and across time based on several factors.
Webmaster Central Blog [googlewebmastercentral.blogspot.com]
This is a great feature.
What would make it even better would be if Google would allow throttling by time of day. I would love to throttle up to the max rate on the over night hours and bring it back to normal during the day. That would be great.
You mean we have to avoid it or what ?
What is this crawl rates actually means as i increased it to 0.5 requests per second but no change in site traffic , but yes in google wmt i can see lot of network unreachable errors , and hosting company site is up 24 hours
So plz help me what to do
Should i change crawl rate?
What positive and negative effects 0.5 request per second have ?
and where i can get full details regarding this feauter
If u can give details here i will be thankful.