Google indexing of jsp

Any advice...

[xbase234]

Working on a product catalog site with over 10,000 pages. The url path of each product page has only one variable, but I can only seem to get less than 100 pages indexed after months of attempts.

Is it possible that cookies or other code is causing the Google bot to rebuff my pages? Any other factors to consider when creating "spider friendly" jsp pages?

[jeremy goodrich]

As long as the variables are limited to no more than 2, and you are not requiring a session variable or cookie to read the pages then you should be fine.

You might not have enough PageRank to get more than a certain # of pages indexed, though.

[xbase234]

PR is 6+, and I do not require session cookies - any other suggestions?

Thanks in advance.

[jatar_k]

do they all use the same page with a var?

ie
pagetemplate.jsp?page_id=123
pagetemplate.jsp?page_id=125
pagetemplate.jsp?page_id=137
pagetemplate.jsp?page_id=392

[xbase234]

Yes - over 10,000 variables based on the same page.

[jatar_k]

now that I have had problems with on some client sites. I would say, in my experience, that it has something to do with it. I have always wondered about that methodology given that, in essence, it's only one page.

This is one of the primary examples where you can see how badly the bots deal with dynamic content sites.

On some sites I have broken it down to use multiple templates through out the site and it has helped.

mod_rewrite on them has yet to let me down.

For sites that I build from the ground up I make them all individual named pages (for the most part) and then include the template. Though I understand that this is not an option for a large, already existing site.

I would think your best bet would be mod_rewrite.

ie
these urls
pagetemplate.jsp?page_id=123
pagetemplate.jsp?page_id=125
pagetemplate.jsp?page_id=137
pagetemplate.jsp?page_id=392

could become
pagetemplate.jsp/page_id/123/
or
pagetemplate/125.htm
or
/137.htm

all depends on how you end up writing your rules.

[WebGuerrilla]

rewrite the urls with no variables and you will get many more pages indexed.

[GoogleGuy]

Definitely agree with jeremy goodrich; if that doesn't work, you could try making the urls look static. That will work for all search engines, not just Google.