Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

googlebot sitemap question

thinking about submitting sitemap, but not decided yet



11:57 am on Jul 9, 2008 (gmt 0)

5+ Year Member

I just started a new website.
there are hundreds of thousands of pages in it.
do i have to list all of them in the sitemap?
looks like it'll exceed the 10M / 50000 links limit
in this case, how to submit the sitemap?
Is there any tool that can help producing the sitemap?

Sorry, I am new in this, any help would be appreciated


12:43 pm on Jul 10, 2008 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Welcome to WebmasterWorld cirlong!

Don't worry about being new to this, we were all new at one point.

Before you start submitting a sitemap it might be helpful if you ask yourself why you are doing it? Sitemaps can help increase the indexing of your site. If you are trying to get your pages to rank better, you should probably focus on link development and the uniqueness of your content instead.

You do not have to list all of your URLs in the sitemap. I rarely submit a sitemap and when I do submit a sitemap I include my tier 1 pages, maybe tier 2 and skip tier 3 (each tier level is based on how important that page is to me). In case you are wondering why I rarely submit sitemaps, that is because I spend alot of time working on the internal linking. Google loves to follow internal links. If you have good enough linking then you can avoid the need for a sitemap. (PS dont forget to get inbound links from external sites)

If you do want to submit all of your URLs and think that it will create too large a file you can break the sitemap up into multiple files, for example one sitemap for each subdirectory.

As for a tool to create the sitemap there are many third party tools that you can use. Just do a search for them. Google even provides a tool (http://www.google.com/support/webmasters/bin/answer.py?answer=34634).

Congratulations on your new site and good luck


1:55 pm on Jul 12, 2008 (gmt 0)

5+ Year Member

Could we remove the url's from from our sitemap after google indexes them.If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index also.

Receptional Andy

2:07 pm on Jul 12, 2008 (gmt 0)

If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index

Probably not, although they might disappear eventually. For URLs you want removed you'll need to use something like robots exclusion, or return a 404 or 410 status for the content.


2:38 pm on Jul 13, 2008 (gmt 0)

5+ Year Member

Thanks goodroi
so I decided not to submit a sitemap.
talking about inbound external links, it's pretty hard
this is my first english website. the contents of it also cannot be unique, coz it's a lyrics website. I am in the middle of nothing-to-do.
So, what i can do is just wait?

Featured Threads

Hot Threads This Week

Hot Threads This Month