Welcome to WebmasterWorld Guest from 188.8.131.52
The crawl rate affects the speed of Googlebot's requests during the crawl process. It has no effect on how often Googlebot crawls your site. Google determines the recommended rate based on the number of pages in your site.
one sitemap.txt for Google and Bing - just a list of alphabetized URLs.
... would you put a link somewhere on one of the primary pages so Google can find sitemap.txt
[edited by: Sally_Stitts at 2:14 am (utc) on Oct 11, 2011]
For best results, follow these guidelines:
* You must fully specify URLs, as Google attempts to crawl them exactly as provided.
* The text file must use UTF-8 encoding.
* The text file should contain nothing but the list of URLs.
* You can name the text file anything you wish. Google recommends giving the file a .txt extension (for instance, sitemap.txt).
You can name the text file anything you wish.
if I could only find out which 2 files Google is NOT indexing