Welcome to WebmasterWorld Guest from 50.17.117.221

Forum Moderators: open

Message Too Old, No Replies

Dynamic pages calls getting indexed?

somedomain.com?CA=2&regio=Freiburg

     
11:05 am on Mar 7, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 4, 2003
posts:5
votes: 0


Hi there,
some days ago, somebody told me that search engines do not index dynamic pages (dynamic page calls) because they fear indexing parts of their own database. Now I just saw Google indexing pages like "somedomain.com?CA=2&regio=Freiburg" , which definitely is a dynamic page call! :-)
Is this normal for Google and or the other search engines so bad?

cu
Michael

11:20 am on Mar 7, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 11, 2002
posts:86
votes: 0


I think Google spiders dynamic pages as long as their dynamic part is not too long and they are linked to from static pages (I don't know if this is really necessary).

e.g. one of my domains file structure is something like:
/xy_products.html
which links to many pages in the form
/widgets.php?code=products&series=123
all of these pages where spidered properly.

Each of above pages again links to
/widgets.php?code=products&series=123&product=456&page=1
these pages did never appear in the index. Either to much parameters or no good links from static pages.

When I switched the structure to .html-urls (widget_123_456_1.html) using mod_rewrite on a similar project all the catalog pages where spidered soon and appeared in the next update.

Ad

11:35 am on Mar 7, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 4, 2003
posts:5
votes: 0


Thanks rincey,
I remarked something like a three parameter threshold on dynamic pages calls, e.g. three parameters and the pages are not indexed any more.
11:46 am on Mar 7, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 6, 2002
posts:88
votes: 0


@rincey: I think Google spiders dynamic pages ... they are linked to from static pages (I don't know if this is really necessary).

It isn't really necessary, also links from dynamic pages are usefull. But better a link like "yourdomain.com" than "...lid=514".

11:56 am on Mar 7, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 26, 2002
posts:58
votes: 0


I had a simple PHP Hangman game on my website, and I never thought about what Googlebot might do with it. It clicked on each letter until it ran out of words, grabbing hundreds of megs of bandwidth from the dynamic urls. The allinurl: search now shows a whopping 79,000 pages for a site with maybe 200 real pages. I hope this doesn't affect anything, or look like SPAM for that matter.

gsx

4:08 pm on Mar 7, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Feb 20, 2002
posts:603
votes: 0


dukeblue219, how do Googlebot do at Hangman? It's not bad at spelling correction, so I imagine it did quite well?
4:18 pm on Mar 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 22, 2003
posts:1022
votes: 0


Hi,

Last month my website was full of dynamic pages, so I put a site map in place with a link from the index page to the site map, and each month GoogleBot hit my site up to 100 times!
Last week I implemented mod_rewrite and replaced all my dynamic links (mydomain.com/Nav.do?par1=string&par2=string2) from the site map to mydomain.com/dir/blah.html GoogleBot visited me yesterday and hit over 900 pages! It is true that GoogleBot can trawl dynamic pages with a limited query length, but I would say that it prefers static pages!

HTH,

-gs