I *think* it can. Easiest way to find out is grab some text from one of the older pages and search for an exact match.
Google doesn't like to spider dynamic pages with 'id' as name for a parameter (because it could turn out to be a session id) or dynamic pages with multiple parameters (3 or more?). So the URL in your example could be a problem.
After a month of dealing with this issue, the general conclusion is yes and no. In other words, google says they can and would index dynamic urls. Other say the same thing a sight examples. On the other hand, people can not seem to get dynamic pages crawled and indexed and they can sight examples as well, all with-in the suggested guidelines.
So in the end, it's really hit and miss and we have not found anything that is definite.
BTW our pages look like this viewprd.asp?idproduct=388. We experiented by removing "id" altogether and we still couldn't get it crawled or indexed.
From my experience, you're always better off with a SE friendly URL. Google (and other SE's) MAY or MAY NOT index a URL like the one listed above.
It only takes a little more work with your .htaccess file and PHP URL "explode" command to generate URLs that look like this:
It's really not much harder to do, and you'll be guranteed that you've got a URL that is not only easier on spiders, but also on your visitors.
I would also recommend if you use PHP Sessions to disable sessions for spiders.
If you need help doing any of these things, sticky me and I'll point you to the tutorials I used to re-write a large part of my site.
I would love to get the link to those resources. I just Stickied you. Thanks for your help!
|people can not seem to get dynamic pages crawled and indexed |
For a simple URL, like /cgi-bin/myscript.pl?ref=1234 it does seem to work OK. One of my sites (which is old, hence the search-engine unfriendly URLs) has over 60,000 pages like this indexed fine (and they don't do too bad on searches either).
However, for the next version of the site I'll certainly switch to something like /main-section-minor-section-page-title.html (with a script back end, not static html). Seems to rank better on other sites I've tried it with, and makes more sense to a human when they see it in the search results, although a little longwinded.
I am using a script for a website and it creates staic pages. It got indexed with over 2000 listings in less then a week giving me a PR4 for the homepage. I am happiest. :-)
I would avoid the "id="--it's used so often for sessions IDs that it can cause a spider to be leery of crawling that url. But if you use any parameter besides "id", I think that url should be fine.
Thanks. Working on it.
Cool, post back with how it goes..
Here is the best article I could find on the subject.
It's very clear and straighforward and takes you through each step of the process.