Maximum number of followed links?

LImit the number of links per page in a sitemap for a complete google index

[thalund]

Frustrated by my sites large number of dynamic pages not being indexed by google I build a sitemap with direct links to every of the sites more than 120.000 single articles.

During the last couple of months I've been experimenting with the number of links on each page of the sitemap.

Monitoring the visits of Google and the presence or non presence of cached versions of the article pages I found: that the google spider pretty consistently only caches and follows the first 1.026 links and ignores any further links.

I then rebuild the sitemap to include a maximum of 1000 links per page - now all pages gets indexed.

Just wanted to share, though this may be commom knowlegde.

[simonuk]

Hi thalund, welcome to WebmasterWorld

Google also has problems with links pages which are roughly over 105kb in file size.

Simon.