submitting several urls to google

[leifwessman]

We have a product DB of about 1000000 products. We would like to have google to index them all. Instead of submitting every url to google we have created a singe html file with links to all products. The file is about 15 MB large.

Is this a good way of doing it or could this lead to any problems? Is there any other solutions?

[ikbenhet1]

Google indexes only 101kb of a file.

Get links to your main pagina, and make a directory like link structure.

[jpavery]

1 million products! really?

[ciml]

Google suggest keeping "the links on a given page to a reasonable number (fewer than 100)". I would agree with that strongly from a PageRank conservation perspective.

leifwessman, if you want to create a useful site about a million products then you're going to need to do a lot of categorisation.

[leifwessman]

I have a search engine. The products are in a database. People search for products - that works fine. However I would like google to index the products.

If I create a directory structure for google. Will it take long for google to index all pages? can it affect the main webpage pagerank?

Leif

[ciml]

Increasing the size of the site will suck some PageRank, but if you have a million pages of interesting content about those products then people will link to you and your PageRank will go.

[leifwessman]

all i want is to people to find our store when they search for products that we sell. i'm not sure that a lot of people will link to us directly.

if i have a main page with links to pages that have links to our products. does that mean that google will not know about our products for at least 3 updates of the index?

[ciml]

I don't think so. If you have enough PageRank for Google to want to follow the links, then it should take one or two updates for changes to show. If you do not have enough PageRank for Google to want to follow the links, then Googlebot won't index them.