Forum Moderators: coopster

Message Too Old, No Replies

Problems With PHP Querystrings

Anyone having any issues with spidering...

         

celgins

7:44 pm on Mar 28, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



We all know that spiders either have trouble crawling sites with "?, &" querystrings, or they don't crawl those pages at all.

I'm about to start a dynamic site and will be writing in PHP/MySQL. Have any of you had success getting dynamic pages indexed without using mod_rewrite?

Vastio

8:01 pm on Mar 28, 2006 (gmt 0)

10+ Year Member



For me, it seems that Yahoo is able to index them just fine. Google, on the other hand, only picks my regular pages regardless of what they say on their website.

From [google.com ]

It's also possible that we're not able to crawl your site due to technical reasons. A few of the most common ones are listed below:

Your pages are dynamically generated. We're able to index dynamically generated pages. However, because our web crawler could overwhelm and crash sites that serve dynamic content, we limit the number of dynamic pages we index. In addition, our crawlers may suspect that a URL with many dynamic parameters might be the same page as another URL with different parameters. For that reason, we recommend using fewer parameters if possible. Typically, URLs with 1-2 parameters are more easily crawlable than those with many parameters. Also, you can help us find your dynamic URLs by submitting them to Google Sitemaps.

barns101

8:32 pm on Mar 28, 2006 (gmt 0)

10+ Year Member



I have loads of dynamic pages indexed by Google in the format of page.php?id=123

However they don't seem to rank very well compared to other websites using mod_rewrite or similar to emulate a static page. It could be that their content is better or they have more backlinks but this doesn't appear to be the case.

I am in the process of getting rid of pages with querystrings in the URL and using mod_rewrite. I suggest that you do this from the start just in case Google et al do rank dynamic pages using querystrings less well than seemingly static pages.

jatar_k

9:35 pm on Mar 28, 2006 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



yes, tons since I have never used mod_rewrite and also never used query strings for my pages

I usually use a site generation script that creats real files for every page.

or I often use little files that set the id and include the template

either/or

no problem

celgins

3:21 am on Mar 29, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I was leaning towards mod_rewrite, but I'll also consider other options.

Thanks for the info.