Welcome to WebmasterWorld Guest from 54.166.203.76

Forum Moderators: goodroi

Message Too Old, No Replies

googlebot sitemap question

thinking about submitting sitemap, but not decided yet

     
11:57 am on Jul 9, 2008 (gmt 0)

New User

5+ Year Member

joined:July 9, 2008
posts:2
votes: 0


I just started a new website.
there are hundreds of thousands of pages in it.
do i have to list all of them in the sitemap?
looks like it'll exceed the 10M / 50000 links limit
in this case, how to submit the sitemap?
Is there any tool that can help producing the sitemap?

Sorry, I am new in this, any help would be appreciated

12:43 pm on July 10, 2008 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3284
votes: 225


Welcome to WebmasterWorld cirlong!

Don't worry about being new to this, we were all new at one point.

Before you start submitting a sitemap it might be helpful if you ask yourself why you are doing it? Sitemaps can help increase the indexing of your site. If you are trying to get your pages to rank better, you should probably focus on link development and the uniqueness of your content instead.

You do not have to list all of your URLs in the sitemap. I rarely submit a sitemap and when I do submit a sitemap I include my tier 1 pages, maybe tier 2 and skip tier 3 (each tier level is based on how important that page is to me). In case you are wondering why I rarely submit sitemaps, that is because I spend alot of time working on the internal linking. Google loves to follow internal links. If you have good enough linking then you can avoid the need for a sitemap. (PS dont forget to get inbound links from external sites)

If you do want to submit all of your URLs and think that it will create too large a file you can break the sitemap up into multiple files, for example one sitemap for each subdirectory.

As for a tool to create the sitemap there are many third party tools that you can use. Just do a search for them. Google even provides a tool (http://www.google.com/support/webmasters/bin/answer.py?answer=34634).

Congratulations on your new site and good luck

1:55 pm on July 12, 2008 (gmt 0)

New User

5+ Year Member

joined:July 12, 2008
posts: 20
votes: 0


Could we remove the url's from from our sitemap after google indexes them.If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index also.
2:07 pm on July 12, 2008 (gmt 0)

Senior Member

joined:Jan 27, 2003
posts:2534
votes: 0


If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index

Probably not, although they might disappear eventually. For URLs you want removed you'll need to use something like robots exclusion, or return a 404 or 410 status for the content.

2:38 pm on July 13, 2008 (gmt 0)

New User

5+ Year Member

joined:July 9, 2008
posts:2
votes: 0


Thanks goodroi
so I decided not to submit a sitemap.
talking about inbound external links, it's pretty hard
this is my first english website. the contents of it also cannot be unique, coz it's a lyrics website. I am in the middle of nothing-to-do.
So, what i can do is just wait?
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members