How do i set Crawl Schedule? Where do i set Crawl Schedule?
can anyone guide me on this... (for my E commerce website i would like to schedule the Google crawling)
lorax
1:08 pm on Jun 21, 2013 (gmt 0)
Welcome to WebmasterWorld Minglekart!
You can't actually "schedule" a crawl. You can set variables that Google will read that tell Google what your crawl preference is. Create and/or log into your Google Webmaster Tools account and look up crawl rate there.
Here is some additional information on WebmasterWorld regarding crawl rates and Google [google.com]
lucy24
8:26 pm on Jun 21, 2013 (gmt 0)
I seriously doubt there is anything you can do to make Google crawl faster than planned. Maybe temporarily if you change your sitemap; not permanently. But you may be able to make them crawl slower.
g will ignore the "Crawl-Delay" line in robots.txt. (They say so explicitly in gwt.) But other robots may honor it.
