Welcome to WebmasterWorld Guest from 54.167.102.69

Forum Moderators: goodroi

Message Too Old, No Replies

How do you make search engines index ALL the urls in a sitemap file?

How do you make search engines index ALL the urls in a sitemap file?

     
7:20 am on Jul 22, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 24, 2003
posts: 115
votes: 0


How do you make search engines index ALL the urls in a sitemap file?
12:18 pm on July 22, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3080
votes: 67


the same way you make google disclose their secret ranking formula to you - you dont.

sitemaps are basically a way to suggest urls to the search engines. search engines are not obligated to index every url and rarely index every url on larger sites.
1:24 pm on July 22, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 24, 2003
posts:115
votes: 0


What percentage indexed is normal ?

e.g. 10%, 30%, 70%, etc

or no such reference at all.
2:49 am on July 23, 2010 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


even if it were 100% you wouldn't be able to determine if it were the fact the urls were in the sitemap or other factors, unless of course some of those urls were not linked or published elsewhere.
4:56 am on July 23, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 24, 2003
posts:115
votes: 0


>> wouldn't be able to determine

Compare before add sitemap and after add sitemap to see the difference.
7:37 am on July 23, 2010 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


correlation (or mere coincidence, for that matter) don't imply causation.
how do you know whether the discovery of a url eventually occurred through internal linking or the introduction of the sitemap unless you have isolated that factor?
9:05 am on July 23, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 24, 2003
posts:115
votes: 0


>> don't imply causation.

agree, but it suggests "higher probability" that it has an influence if good result after the change not long.
12:45 pm on July 23, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3080
votes: 67


there arent good numbers to go by. google and the other search engines have said quite often that they prefer to discover urls by following links instead of submitting sitemaps. however i have seen sitemaps help large websites increase the amount of pages indexed.

i cant tell you what percentage because as phranque points out i wouldnt know if google found the url via sitemap or via links or possibly even via toolbar usage.

sitemaps can help certain websites with indexing issues. imho most websites are better served by making sure all pages are internally interlinked and developing inbound links from many external websites. this will help indexing and more importantly improve the rankings of the pages that are indexed.

dont forget that unique content can also have a significant impact on your indexing %. if you have 1 million pages and they are all identical, then search engines will not want to index all of your pages. good luck