Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Sitemaps - Do all my urls need to be included?

google, sitemap

8:36 pm on Sep 21, 2006 (gmt 0)

Junior Member

5+ Year Member

joined:Sept 2, 2006
votes: 0

If I have a large number of static pages, do each of these urls "need" to remain in my sitemap file(s)?

Many of these have been indexed by google quite awhile ago. Will google drop them from the index if the url is removed from the site map and the bot never finds another page on the site that points to it?

Just looking for guidance on whether have so many pages in my sitemap hurts us or not. We've talked about reducing the number of sitemap files down into the thousands with only new content pages. Not sure if this is the right way to go.

4:18 am on Sept 22, 2006 (gmt 0)

Full Member

10+ Year Member

joined:Oct 19, 2002
votes: 0

I can only reply from my own experience with a much smaller website. I neglected to add a certain URL when I uploaded my sitemap months ago. I don't often visit that page, but after the last PR update I noticed that page had lost it's PR and no cache was available. I immediately added the missing URL and the next time my site was spidered it was found and re-indexed.
5:28 pm on Sept 23, 2006 (gmt 0)

Junior Member

5+ Year Member

joined:May 7, 2006
votes: 0

I think G can find additional links the way it always has. I have pages cached that are not in the sitemap.
11:24 pm on Sept 23, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 17, 2005
votes: 0

A Sitemap file augments our normal discovery crawl. If you submit a Sitemap, we don't exclusively crawl from only that -- it's simply additional information. You can definitely submit a Sitemap file with only new content and it won't hurt your other pages.
12:53 am on Sept 24, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 24, 2003
votes: 0

I provide Google with a sitemap for only around 4,200 URLs for my site; however, Google indexes all 18,000+/- pages. So to answer your question, Google will still find the other pages.