Good Page Rank but having problems with my Dynamic Content!

Any suggestions how I can get my dynamic content indexed?

[Innit]

Please check out my profile for the url.

I'm working on a recruitment web site with a decent PR of 7/10. The problem is for some reason alot of our content, specifically the job descriptions are not getting indexed on a regular basis.

Our job descriptions are created dynamically, so I'm thinking of creating an HTML page linked to my home page which is updated with all the current job openings twice a day. I'm hoping this will help me get that content indexed.

Somone mentioned that we might have some java script blocking googlebot but I'm not seeing that...

Would welcome any suggestions / comments.

Thanks.

[trillianjedi]

There's no URL in your profile, but think the answer to your problem may lie in mod_rewrite anyway, which will rewrite your dynamic URL's to static ones for you.

TJ

[RonPK]

Well, even a PR 9 news site like CNN's has a 4 days old page in Google's cache. You can't expect Googlebot to drop by 5 minutes after you've updated your site and immediately update the index - across all datacenters.

This being said, I'd suggest to put short job descriptions on the page Googlebot (Freshbot) visits most often - probably your home page.

[Netizen]

trillianjedi: or the other way around :-)

Use mod_rewrite to convert static links on the web site into dynamic links for your scripts. For example, you can get

www.domain.com/jobs/3/cv.html

to be rewritten as

www.domain.com/jobs.php?id=3&type=cv

Also, are those pages available without having to log in or anything else which might keep a spider out?#

Hope that helps.

[olwen]

I use a pseudo directory structure that forces a file to be processed with php.

.htaccess looks like
<Files region>
ForceType application/x-httpd-php
</Files>

My link is to region/xx and a new update to the site has region/xx/yy

I parse out the pieces and select from the database. Its a technique I found on phpbuilder, and my site seems to be well indexed.

[Innit]

ok it's not showing my url in the profile as I'm not yet a full member so in order for me to make sense on this thread I hope you don't mind if I post it: [recruit.net...]

I'm having a hard time getting the job descriptions indexed...

thanks,

[Netizen]

Have you tracked GoogleBot's visits through the site? Does it stop at some point, or has it been through those pages and you are just wondering when they will turn up on Google?

[Netizen]

Looking in Google you have 900 pages listed, including job listings, etc. Doesn't seem to be much of a problem there.

[PRNightmare]

I just looked at your site.

1. You're OK with the single variable in your URL-string. Any more than that and Google would not index. So, the mod-rewrite is not absolutely needed to get a job description page indexed.

2. You should consider changing the method by which you page through the jobs. Currently you are using a javascript to advance through the pages of jobs. Can you change that so that it is a hard-coded url? That will help Google to follow and index jobs beyond the first 10 in each category.

Just some ideas.

[Innit]

what I've noticed is that most of our job listings on Google are OLD. None of the new stuff (last 3 months) is being indexed. We recently set up ISAPI_Rewrite to simplify our directory structure and this may be part of the reason.

For example the job listing here: [recruit.net...] is only generated when a search criteria is met, so how would GOOGLE index this on a normal visit?

[vincevincevince]

make a site map containing all the urls for all the jobs and link it from your index page. you should be able to get the database to dynamically generate it each time.

[Netizen]

Has Google spidered the site in the last 3 months?

Take a browse on this site about "Update Dominic" - a lot of the data in the SERPs are 2-3 months old unless you are being visited by Google's FreshBot.

[Alphawolf]

There should be a post of the front page of WW stating google is using 3 mo old data for many sites.

Innit, before you go nuts have a look here and the threads it links to:

[webmasterworld.com...]

Regards,

AW

[Yidaki]

Innit, nice site you have! Allthough the url might get zapped [webmasterworld.com] by a mod. ;)

I don't have a clear answer to your question but found some things that should be changed imho and could improve rankings and crawling drastically imho.

1) make ALL javascript code external (there's a lot at your exmple url).
2) i'd move the search box to the bottom of the page. Doesn't make sense to have it at the top of the page if you're allready looking at a job offer - which is a result allready.

... goal of the above changes is to move the important content to the top of your site - into the first characters that are read and indexed by google or any other search engine.

3) put the most important phrase (the job offer title itself) into the page title, into the link anchor text that point to the offer and into a headline tag <h1>. Let's not discuss about the value of <h> tags in general - the mix is the "secret".

I wouldn't stress to much about current flux observtions but work on your site's structure instead. More improvements could be:
- mod_rewrite the dynamic to static url's (allready suggested)
- group the job offers into logical groups / themes / categories
- read about theme pyramids [searchengineworld.com] and theme pyramids at google [webmasterworld.com] .. your site might be a good candidate for such a structure.

Enough hints given - anything else costs money. ;) Na joking! You'll find a lot of answers if you read carefully here at WebmasterWorld and use the site search.

[TeofenGL]

Has anyone put any thought into the potential ranking difference between the pseudo directory structure and a $PATH_INFO string delineated by another character (not a slash)?

like this:

site.biz/hub/article-tech-200306-1443.html

instead of

site.biz/hub/article/tech/200306/1443/

-- we use this on a few sites with some hairy structures, and i'm wondering if the perceived directory depth is suboptimal for ranking - as PR generally falls off the deeper you go...