homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

GWT Sitemap and Google Bot Crawl Rate

 12:03 pm on Dec 12, 2013 (gmt 0)

I haven't added a sitemap to Google Webmaster Tools before because I was concerned since not all of my new material gets added to the sitemap of my site. I was afraid Google would concentrate more on the sitemap than crawling the rest of my site and end up missing this new material from my site.

If you add one or more sitemaps, does Google Bot crawl rate go down or do they still try to find new/updated material the old fashion way?

[edited by: aakk9999 at 12:06 pm (utc) on Dec 12, 2013]
[edit reason] replaced "site index" with "sitemap" to make a question clearer [/edit]



 1:40 pm on Dec 12, 2013 (gmt 0)

If there's a link to it somewhere, Google will find it. They may or may not index or rank it, but they'll find it.


 9:45 pm on Dec 12, 2013 (gmt 0)

So you recommend the sitemap then?

All of my articles are included in the sitemap but it is the user generated comments and when I update pages on topics etc.. (which are not articles) that don't get included in the sitemap.

Google still crawls the site as per norm looking for other new content beyond what is included in the sitemap?



 3:29 am on Dec 13, 2013 (gmt 0)

google is pretty good with link discovery.
make sure googlebot doesn't discover non-canonical urls in your sitemap and you should be okay.
perhaps more important for link discovery is a good internal link structure and external links to your site from relevant and authoritative content.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved