Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Site Map

How long is to long?

8:16 pm on Jul 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 27, 2003
votes: 0

I have a Site Map that is more of a Product List that links all my items (600+) on the site from A to Z The dilemna is I am not sure if Google is reading every link on that page? Is there a good way to set up a site map that Google will love and index correctly?
9:02 pm on July 17, 2003 (gmt 0)

Full Member

10+ Year Member

joined:July 24, 2002
votes: 0

I believe the consensus is you want to stay under 101K for page size...

If it's already in the index, just look at Google's cache of your page, and make sure it has the whole page.

<edit>Sorry, I meant UNDER 101k, not over</edit>

[edited by: Neo541 at 9:33 pm (utc) on July 17, 2003]

9:28 pm on July 17, 2003 (gmt 0)

Senior Member from DE 

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 20, 2003
votes: 4

Google recommends less than 100 links on a page. Therefore, I would split the sitemap.
9:35 pm on July 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 16, 2002
votes: 0

If I did split the site map how deep will google bot dig?
9:41 pm on July 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 27, 2002
votes: 0

Google recommends under 100 links but I've got a sitemap for 20,000 pages split into 20 pages of 1000 links and all are spidered. Depends on your homepage PR as well as to how deep googlebot will spider - this site is PR6.
9:47 pm on July 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member bigdave is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Nov 19, 2002
votes: 0


Though a sitemap is a good thing to have, do you know why Google doesn't completely crawl your site through the standard navigation?

How old is your site? It genearlly takes Google a couple of months to get into gear and do a complete crawl of your site, whether or not you have a sitemap.

Are you using javascript or some other form of navigation that Google doesn't follow? Generally not a very good plan. You can lose a fair number of users too if you go that route. Especially if your navigation doesn't work for those with ad blocker software or popup blockers.

What is the PR of your site? Sometimes google just doesn't have time to crawl all the pages of sites that are way down the list. Even a site map may not help all that much in a case like this. If your home page is <PR3 you better get some more links. Heck, you should get some more links even if you have a PR7.

Do you have any external links going to your deeper pages? These can really help with crawling and ranking as long as your navigation works well.

If you take care of these basics, you should not have a need to have a site map that lists every product just to get crawled.