Dynamic pages calls getting indexed?

somedomain.com?CA=2&regio=Freiburg

[chefdynamiker]

Hi there,
some days ago, somebody told me that search engines do not index dynamic pages (dynamic page calls) because they fear indexing parts of their own database. Now I just saw Google indexing pages like "somedomain.com?CA=2&regio=Freiburg" , which definitely is a dynamic page call! :-)
Is this normal for Google and or the other search engines so bad?

cu
Michael

[rincey]

I think Google spiders dynamic pages as long as their dynamic part is not too long and they are linked to from static pages (I don't know if this is really necessary).

e.g. one of my domains file structure is something like:
/xy_products.html
which links to many pages in the form
/widgets.php?code=products&series=123
all of these pages where spidered properly.

Each of above pages again links to
/widgets.php?code=products&series=123&product=456&page=1
these pages did never appear in the index. Either to much parameters or no good links from static pages.

When I switched the structure to .html-urls (widget_123_456_1.html) using mod_rewrite on a similar project all the catalog pages where spidered soon and appeared in the next update.

Ad

[chefdynamiker]

Thanks rincey,
I remarked something like a three parameter threshold on dynamic pages calls, e.g. three parameters and the pages are not indexed any more.

[MOOSBerlin]

@rincey: I think Google spiders dynamic pages ... they are linked to from static pages (I don't know if this is really necessary).

It isn't really necessary, also links from dynamic pages are usefull. But better a link like "yourdomain.com" than "...lid=514".

[dukeblue219]

I had a simple PHP Hangman game on my website, and I never thought about what Googlebot might do with it. It clicked on each letter until it ran out of words, grabbing hundreds of megs of bandwidth from the dynamic urls. The allinurl: search now shows a whopping 79,000 pages for a site with maybe 200 real pages. I hope this doesn't affect anything, or look like SPAM for that matter.

[gsx]

dukeblue219, how do Googlebot do at Hangman? It's not bad at spelling correction, so I imagine it did quite well?

[Alternative Future]

Hi,

Last month my website was full of dynamic pages, so I put a site map in place with a link from the index page to the site map, and each month GoogleBot hit my site up to 100 times!
Last week I implemented mod_rewrite and replaced all my dynamic links (mydomain.com/Nav.do?par1=string&par2=string2) from the site map to mydomain.com/dir/blah.html GoogleBot visited me yesterday and hit over 900 pages! It is true that GoogleBot can trawl dynamic pages with a limited query length, but I would say that it prefers static pages!

HTH,

-gs