Forum Moderators: open

Message Too Old, No Replies

Question about "dynamic" site pages?

Why don't SE's see them?

         

vdc_ent

4:16 pm on Dec 11, 2003 (gmt 0)

10+ Year Member



Why is it that search engines like Google and Yahoo do not recognize "dynamic" site pages as legitimate to a site's construction?

Who made this "rule" and why?

It seems a bit archaic in these times of ecommerce and the amount of ecommerce on the Internet.

jtbell

6:19 pm on Dec 11, 2003 (gmt 0)

10+ Year Member



Google *does* crawl dynamic pages, but with some restrictions. For example, it doesn't like to crawl URLs with query strings that contain a parameter named "id" because it's often a session ID that changes from one visit to the next. Also, I've read that Google is more likely to crawl dynamic pages deeply if the starting page has a high PageRank value.

jatar_k

6:22 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



with each query string you get different content but it is truly the same page.

Use mod_rewrite or find a way to redesign into actual pages. Huge query strings are a pain anyway. Hard for someone to email it to a friend, impossible for someone to remember a specific page off the top of their head, etc.

They also look nasty ;)

AjiNIMC

6:26 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The normal sites ( I mean static) is more preffered as it gives you a better and clear picture of the site, while a dynamic site has complexity associated with it.

Aji

vdc_ent

7:22 pm on Dec 11, 2003 (gmt 0)

10+ Year Member



Thank you all for your input... I still don't know how you can get a higher Page Rank if you can't be seen in the first place! My home page is not "dynamic", but the product pages are. So the site will never get "ranked" because Google/Yahoo sees it as a one page only site. It is the site builder I used when I was a newbie and didn't know better. To rebuild or transer is too big for me to consider.

Outside of building static pages that link back to my site, does anyone have any other helpful suggestions?

jatar_k

7:27 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



The normal sites ( I mean static) is more preffered

a lot of my sites look perfectly static and none are

rewrite the url's so they look static.

An Introduction to Redirecting URLs on an Apache Server [webmasterworld.com]

SoleDrag

11:05 pm on Dec 11, 2003 (gmt 0)

10+ Year Member



So id=blahblahblah is a no no right?

What about:

[widgets.com...]

If I have to change this, I'm gonna be sick.

jatar_k

11:15 pm on Dec 11, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



?ca=3

shouldn't be viewed as an id

jranes

11:22 pm on Dec 11, 2003 (gmt 0)

10+ Year Member



Trust me, there are sites with nice short q string params that have thousands and thousands of dynamic pages indexed.

AjiNIMC

2:00 am on Dec 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



even some of my dynamic pages were among the first indexed pages of my site. They are still there though I am re-directing it.

The best is redirect it and make it simple and static.

The keyword is

"SIMPLE for USER"

Aji

lgn1

3:16 am on Dec 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Does anybody have An Introduction to Redirecting URLs on an Microsoft IIs server.

I can find plenty of info on Appache, however our ISP in there infinite stupidity went with IIS.

Our ISP is great otherwise, so we rather work around the IIS issues rather than switch to an ISP that uses the industry standard Appache.

BlueSky

3:37 am on Dec 12, 2003 (gmt 0)

10+ Year Member



The SE's are cautious about dynamic urls because they don't want their bots to get lost and don't want to crash your server. I've seen bots get lost quite frequently on other people's sites when urls have session ids. They'll pull the same pages over and over day after day as the id changes, but the content doesn't. With dynamic pages, there's no way for them to tell how many you have. On some sites, they could end up requesting pages for an extremely long time with no end in site. So, where do they cut off? One, two, five, ten, or more variables? The more there are the more paths the bot could go down and possibly get lost. So, they arbitrarily limit it.

If you rewrite the urls to make them static looking, the bots will index your pages with no problems. However, if you get a lot of them accessing your site at the same time, they can easily slow your site and server way down or even crash it.

pageoneresults

3:45 am on Dec 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Does anybody have An Introduction to Redirecting URLs on an Microsoft IIs server.

I've reviewed a few of the programs that are available on the market for redirecting URIs in IIS. I would recommend the ISAPI Rewrite program as it is probably the most robust of the programs available.

You'll need to familiarize yourself with the use of regular expressions. You'll also want to prepare for setting up your 301s and 404s where applicable.

Rewrite your URIs so they are short and descriptive with minimal use of hyphens. You want to make them easy to read, bookmark and share with others verbally.

Careful planning needs to go into the new URI structure. Once you have them set up, you don't want to change them.

vdc_ent

4:56 am on Dec 12, 2003 (gmt 0)

10+ Year Member



Again... thanks for all the great info. How can I "rewrite" the URLs to make them appear static? Please don't make the explanations too techno... I'm still a newbie in many ways...