Welcome to WebmasterWorld Guest from 54.234.38.8

Forum Moderators: buckworks

Message Too Old, No Replies

Crawl Schedule

How do i set Crawl Schedule

     
12:53 pm on Jun 21, 2013 (gmt 0)

New User

joined:June 21, 2013
posts: 3
votes: 0


How do i set Crawl Schedule?
Where do i set Crawl Schedule?


can anyone guide me on this... (for my E commerce website i would like to schedule the Google crawling)
1:08 pm on June 21, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lorax is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Mar 31, 2002
posts:7575
votes: 0


Welcome to WebmasterWorld Minglekart!

You can't actually "schedule" a crawl. You can set variables that Google will read that tell Google what your crawl preference is. Create and/or log into your Google Webmaster Tools account and look up crawl rate there.

Here is some additional information on WebmasterWorld regarding crawl rates and Google [google.com]
8:26 pm on June 21, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12719
votes: 244


I seriously doubt there is anything you can do to make Google crawl faster than planned. Maybe temporarily if you change your sitemap; not permanently. But you may be able to make them crawl slower.

g will ignore the "Crawl-Delay" line in robots.txt. (They say so explicitly in gwt.) But other robots may honor it.
11:23 am on June 24, 2013 (gmt 0)

New User

joined:June 21, 2013
posts: 3
votes: 0


@lorax - Thanks for the valuable reply