homepage Welcome to WebmasterWorld Guest from 184.73.104.82
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
googlebot sitemap question
thinking about submitting sitemap, but not decided yet
cirlong

5+ Year Member



 
Msg#: 3694268 posted 11:57 am on Jul 9, 2008 (gmt 0)

I just started a new website.
there are hundreds of thousands of pages in it.
do i have to list all of them in the sitemap?
looks like it'll exceed the 10M / 50000 links limit
in this case, how to submit the sitemap?
Is there any tool that can help producing the sitemap?

Sorry, I am new in this, any help would be appreciated

 

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3694268 posted 12:43 pm on Jul 10, 2008 (gmt 0)

Welcome to WebmasterWorld cirlong!

Don't worry about being new to this, we were all new at one point.

Before you start submitting a sitemap it might be helpful if you ask yourself why you are doing it? Sitemaps can help increase the indexing of your site. If you are trying to get your pages to rank better, you should probably focus on link development and the uniqueness of your content instead.

You do not have to list all of your URLs in the sitemap. I rarely submit a sitemap and when I do submit a sitemap I include my tier 1 pages, maybe tier 2 and skip tier 3 (each tier level is based on how important that page is to me). In case you are wondering why I rarely submit sitemaps, that is because I spend alot of time working on the internal linking. Google loves to follow internal links. If you have good enough linking then you can avoid the need for a sitemap. (PS dont forget to get inbound links from external sites)

If you do want to submit all of your URLs and think that it will create too large a file you can break the sitemap up into multiple files, for example one sitemap for each subdirectory.

As for a tool to create the sitemap there are many third party tools that you can use. Just do a search for them. Google even provides a tool (http://www.google.com/support/webmasters/bin/answer.py?answer=34634).

Congratulations on your new site and good luck

ripejuice

5+ Year Member



 
Msg#: 3694268 posted 1:55 pm on Jul 12, 2008 (gmt 0)

Could we remove the url's from from our sitemap after google indexes them.If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index also.

Receptional Andy



 
Msg#: 3694268 posted 2:07 pm on Jul 12, 2008 (gmt 0)

If we remove a url from sitemap that is not linked from anywhere other than our sitemap then will google remove that url from their index

Probably not, although they might disappear eventually. For URLs you want removed you'll need to use something like robots exclusion, or return a 404 or 410 status for the content.

cirlong

5+ Year Member



 
Msg#: 3694268 posted 2:38 pm on Jul 13, 2008 (gmt 0)

Thanks goodroi
so I decided not to submit a sitemap.
talking about inbound external links, it's pretty hard
this is my first english website. the contents of it also cannot be unique, coz it's a lyrics website. I am in the middle of nothing-to-do.
So, what i can do is just wait?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved