Forum Moderators: open
I hear some people say that dynamic URLs will get you banned. However, I see them all over Google and Yahoo and MSN.
So, those search engines have grow and matured in my opinion.
Now if somebody can critique my theory for a moment:
I am using a lot of dynamic URLs in my web site. So, to make the search engines happy, I am using a static site map which links to all the dynamic URLs on my web site. To me, this is the way it works, but I am not 100% sure. So, if somebody can tell me what YOUR take on this is, that would be great.
Also, just for the record, most web sites use MySQL and SQL databases which work by dynamic URLs. So, can dynamic URLs really be that bad to the SEs?
Is the dynamic URL issue just a thing of the past?
I hear some people say that dynamic URLs will get you banned.
Is the dynamic URL issue just a thing of the past?
I would suggest looking here: mod_rewrite search engine friendly [google.com]
Elijah
The problems in the past have been that using dynamic URL requests to a webserver can, in certain circumstances, result in a recursive loop for the spiders.
Because of this google and the others have, in the past, restricted indexing of the types of dynamic URL which can cause this problem. Session ID's cause similar issues (each bot sees each URL with a unique SID, and therefore ends up indexing potential thousands of copies of the same page, as the unique SID makes the URL look unique).
It used to be the case that, taking google as an example, googlebot would ignore URL's with more than two variable entries. My understanding, from info here and looking at my logs, is that google is now better at dealing with higher variable entries now than it has been in the past.
To be safe, re-writing your URL's will, again as Elijah states, be better for the SE Spiders and your users (as long as you use logical re-writes).
Doing this is the best way to ensure that all your pages are crawled by all the search engines.
TJ
It is just such a pain. LOL. For the sake of SEM, ok I will have too do it. LOL
Now, What do you think about the file extensions for the URIs? I still can not decide for sure if it is better to go with or without extensions, ie:
www.example.com/topic/page
instead of
www.exemple.com/topic/page.html
I have read that the .html (or .asp, .php, .htm) does not mean anything for the SE nor for the reader so you should not enforce it .. but some people say that some SEs can be expecting to find some extension to index and if there is no extension those couldn't index some pages. Whan you can not do is to end all your URIs with an slash '/' like:
www.example.com/topic/page/
This could create some confusion for SEs or Web Servers, becaue they could try to load the default index.html or wharever defautl is configured.
What do you think?
Carlos.
As so far I know up to 2 are fine, but I think it is the case for GG.. I'm not sure about other spiders.
Carlos.
So, to make the search engines happy, I am using a static site map which links to all the dynamic URLs on my web site. To me, this is the way it works, but I am not 100% sure. So, if somebody can tell me what YOUR take on this is, that would be great.
That's a great way to do it ... as is the other advice here.
