Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Sitemaps - Do all my urls need to be included?

google, sitemap


RobDog SnoopCat

8:36 pm on Sep 21, 2006 (gmt 0)

5+ Year Member

If I have a large number of static pages, do each of these urls "need" to remain in my sitemap file(s)?

Many of these have been indexed by google quite awhile ago. Will google drop them from the index if the url is removed from the site map and the bot never finds another page on the site that points to it?

Just looking for guidance on whether have so many pages in my sitemap hurts us or not. We've talked about reducing the number of sitemap files down into the thousands with only new content pages. Not sure if this is the right way to go.


4:18 am on Sep 22, 2006 (gmt 0)

10+ Year Member

I can only reply from my own experience with a much smaller website. I neglected to add a certain URL when I uploaded my sitemap months ago. I don't often visit that page, but after the last PR update I noticed that page had lost it's PR and no cache was available. I immediately added the missing URL and the next time my site was spidered it was found and re-indexed.

Right Reading

5:28 pm on Sep 23, 2006 (gmt 0)

5+ Year Member

I think G can find additional links the way it always has. I have pages cached that are not in the sitemap.


11:24 pm on Sep 23, 2006 (gmt 0)

5+ Year Member

A Sitemap file augments our normal discovery crawl. If you submit a Sitemap, we don't exclusively crawl from only that -- it's simply additional information. You can definitely submit a Sitemap file with only new content and it won't hurt your other pages.


12:53 am on Sep 24, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I provide Google with a sitemap for only around 4,200 URLs for my site; however, Google indexes all 18,000+/- pages. So to answer your question, Google will still find the other pages.

Featured Threads

Hot Threads This Week

Hot Threads This Month