Forum Moderators: open

Message Too Old, No Replies

Dynamic content clarification

What kind of dynamic?

         

Patrick Taylor

2:34 pm on Apr 18, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google say they crawl and index dynamic pages (with some caveats). As a comparative newcomer to building dynamic pages (and having searched these forums before raising the point) I would appreciate some clarification of what this means.

I understand dynamic to be content that isn't written in html but is called up from a database by scripting within the page - in my case, PHP. A simple example I'm familiar with is a list of companies which appears when the page is opened in the browser without any action on the user's part. The content is called up by a PHP/MySQL query, which is obviously selective in what data is called up, and the URL of the page is simply something like mypage.php. Is this list of companies crawled by Google, and if so, how? Does the bot run the script? I apologize if this seems like a stupid question, but increasingly when one searches Google, one finds things like forum posts appearing in SERPS, which must presumably exist only in the database until the page is opened (and a scripted query actioned).

Forums are just one example. It's become a simple matter for a web designer to build a site - say for a small business that doesn't want to re-employ the designer after the initial site is built - so that the client can enter and update their own content through an online form (without any knowledge of website construction). The question of whether this content, held in a database, is indexed and contributes to the ranking of the page (subject to search terms) is a crucial one. So what do Google mean when they say they can crawl and index dynamic pages?

Patrick Taylor

3:43 am on Apr 19, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When a question doesn't get answered, it usually means (i) it's a Sunday, and/or (ii) it's a stupid question, and/or (iii) it's a boring question. I've done some more delving and even though it was a Sunday, I've decided it was a stupid question, though I did ask "what kind of dynamic?".

I'm interested in whether there is any disadvantage, in Google terms, in putting the content of a page in a database and having it called up with a scripted query in the page. I mean a query that requires no form action on the part of the user and where the page URL is something like mypage.php.

I can now see there's a difference as regards the URLs. In my instance - case 1 - the URL is a simple one, but when a form action is triggered by a user, a new and more complex URL - case 2 - is created with a new page (or version of the existing page) and which contains variables according to user input.

So I'm now assuming (hopefully correctly) that so long as the URL contains no variables, it doesn't really come under the normal definition of "dynamic" and that there is no Google ranking disadvantage in building case 1 type pages - they're really static pages even though their content comes from a database.

mykel79

8:24 am on Apr 19, 2004 (gmt 0)

10+ Year Member



You answered your own question :) As long as there are no parameters, there's no way for Google to know that the page content is taken from the db, therefore dynamic.
But Google will spider pages with parameters, too. Just keep them at a reasonable number and try to avoid Googlebot getting session parameters, if you use sessions on your site.

Patrick Taylor

10:04 am on Apr 19, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes I did, but thanks for the clarification. I was (wrongly) thinking that the presence of any scripted query made the page dynamic.

gaouzief

11:20 am on Apr 19, 2004 (gmt 0)

10+ Year Member



You answered your own question :) As long as there are no parameters, there's no way for Google to know that the page content is taken from the db, therefore dynamic.

that's not totally right, google could determine if a page is dynamicly generated by the headers sent, for example php outputs by default a header like

x-powered-by:php

But i'm not sure google checks that

g1smd

9:58 pm on Apr 21, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



A "view source" of the HTML code of the page should reveal no clues as to whether it is a static page or has been dynamically generated.

The only visual clues could be developer's <!-- comments --> which the search engine would not see anyway, and the different type of URLs that might be used (unless you use mod_rewrite, and then you really cannot tell at all).

trimmer80

10:37 pm on Apr 21, 2004 (gmt 0)

10+ Year Member



I have produced content management systems, such as you are discussing, in languages such as php, asp, asp.net and have never had an issue getting them indexed by google.
Some use up to 3 parameters, others none, with no side effects. Simply dont use a parameter called 'ID' in the querystring, create a logical navigation structure that the bots can get through and will distribute your PR effectively. :)

ogletree

11:04 pm on Apr 21, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You can find just about any type of URL in Google these days. I even saw some URL's that had 3 equal signs whcih I thought they would not spider for sure. The whole point about dynamic URL's is that in the past there have been some problems. Google seems to get better and beter at it every day. Brett had a real good post (Post #14 [webmasterworld.com] about long URL's a while back.

trimmer80

12:23 am on Apr 22, 2004 (gmt 0)

10+ Year Member



a little OT but I am wondering if anyone has had any luck in finding a mod_rewrite for windows (IIS) that does not need to be installed on the server. Been looking for a while and never seen one.

g1smd

10:20 pm on Apr 22, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Since it is a server side script doing the processing, I can't think of any way of doing this at any place, other than on the server itself.

trimmer80

11:23 pm on Apr 22, 2004 (gmt 0)

10+ Year Member



i know it needs to be processed on the server. I just dont have access to the server to install components, register dlls etc.