Forum Moderators: open

Message Too Old, No Replies

Making Dynamic Content Static

Can this cause duplication concerns?

         

adfree

10:53 pm on Nov 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I got an ASP shop running, obviously G and other SE's don't index most of the dynamic content.

Now, downloading parts of that site (let's say the browsing structure and other link-heavy pages) and interlinking with another core (neighbor) site that's static, does that do any good?

How is the whole duplication concern hurting me?

Thanks for your tips, Jens

adfree

1:00 pm on Nov 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



O.K. - maybe I wasn't all too clear about this, let's try it that way:

A dynamic site calls upon product data to assemble the product pages. Browse and other major anchor and nav pages are dynamic too but could easily be re-created static (not too many changes expected).

Now, when downloading the asp files with a tool to make them static at the same time, uploading them again after some tweaking (the dynmaic pages wil still be there), do I run into trouble of duplicated content? Certainly not with the SE's that do not recognize the dynamic pages, but how about the ones who recognize both formats?

Thanks, Jens

richardb

4:05 pm on Nov 11, 2003 (gmt 0)

10+ Year Member



OK I'll bite

Why do you wish to have both?

Rich

pageoneresults

4:10 pm on Nov 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hello adfree, you may want to review a few posts I made in this thread...

Search Engine Friendly Shopping Carts [webmasterworld.com]

The duplication concerns you have are warranted. In Google's case, it will keep one of the two URIs in the index. Usually the one that has the most PR. If there is no PR assigned yet, it is going to keep the one it indexed first. I've found that Google is pretty good at merging duplicate content but I wouldn't want to take the chance.

If you are generating static pages from your dynamic content, then you need to Disallow your dynamic URIs in the robots.txt file.

A much easier way to do this would be to institute a URI Rewrite program and work with existing content instead of generating all of that additional static content you are referring to.

adfree

5:35 pm on Nov 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



richardb - the issue is: there are several thousand product pages with shopping cart functionality. I won't want to lose the dynamic updates either.

But for SE's to eat up and index the nav structure and pages better I figure to do this part static, not asp.

So, basically it would be the product pages running with the database and the browsing and nav structure pages being static.

How about doing all within one URL?

Jens

adfree

5:55 pm on Nov 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



pageoneresults thanks for the link(s). Certainly interesting.

What it boils down to is that there are several options and you just need to watch out for the duplication not to kick in.

I got plenty of space and don't mind to re-load 50,000 static pages every 6 months or so.

If I was to optimize the static pages then, direct the users in the last step to the dynamic product pages with the cart and disallow all bots on the dynamic content site via robots.txt (run it on two different URL's), would that work?

Thanks, Jens

pageoneresults

6:01 pm on Nov 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If I was to optimize the static pages then, direct the users in the last step to the dynamic product pages with the cart and disallow all bots on the dynamic content site via robots.txt (run it on two different URL's), would that work?

I would think so. Although I feel you may be taking the long route in doing so. I would definitely suggest looking into a URI Rewrite program for your server and go that route if you can. You'll be that much further ahead and won't have to maintain 50,000 static pages, whew, that is a lot of pages just sitting there with content getting stale.

What's nice about the URI Rewrite is that those pages will never get stale as they are being generated on the fly per the request.

P.S. The two different URIs is not something I would do personally. It is going to create some confusion for the user and there may be other issues to contend with such as branding.

adfree

12:21 pm on Nov 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Very valuable, many thanks!
Jens

adfree

8:36 am on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



pageoneresults - installed the ISAPI_Rewrite program.
Now I am having some trouble and was hoping you could enlighten me as I am not too techy.

As I am running a software that picks up data from an external database and returns .aspx results I am struggling a bit to understand the config.

Do you have experience with .aspx?

Thanks, Jens

zf007

9:31 am on Nov 13, 2003 (gmt 0)

10+ Year Member



adfree:

Let us know what's your problem specificly.

adfree

12:26 pm on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Docs are generated using AWS, externally obviously.

I only found this expression combination as an example which seems to attack a pure xml issue only:

[ISAPI_Rewrite]

RewriteRule /doc(.*)\.htm /XMLProcess.asp\?xml=$1.xml

It does not really help me much as AWS returns packaged data sets included in the final .aspx.

Is there any expression that tackeles exactly this?

Thanks, Jens

adfree

11:20 pm on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



O.K. now, after many hours of reading and finally installing IIS Rewrite (just seemed a tad more user friendly) I am still havng issues.

My original URL looks like this

[store.mysite.com...]

In IIS Rewrite I tried expression:

RewriteRule /product.aspx?asin=(.*) /product/$1.htm

expecting it would return

[store.mysite.com...]

Doesn't work, what am I missing?

Thanks, Jens

adfree

8:40 pm on Nov 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



O.K. - I still hope there are guys out there knowing IISRewrite. I solved the easier rewrites but: the more complicated ones I am still struggeling a bit:

This is how the expression looks...
RewriteRule ^/shop/browse/(.*).htm /shop/browse.aspx?mode=$1

...for a simple URL like that...
[store.example.com...]

Now, for a URl like this...
[store.ad-free.net...]

...trying this...
RewriteRule ^/shop/browse/(.*)-(.*).htm /shop/browse.aspx?mode=$1&pid=$2

...or this...
RewriteRule ^/shop/browse.aspx?mode=(.*)&pid=(.*) /shop/browse-$1-$2.htm

...failed miserably...

Anyone with a better idea?

Thanks, Jens

pageoneresults

11:06 pm on Nov 15, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



adfree, have you tried reviewing the manufacturers documentation?

http*//www.iisrewrite.com/en/documentation/

adfree

9:31 am on Nov 17, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks, I got it sorted out now by trial and error and help from the manufacturer, Jens