Forum Moderators: open
A few recent sites that I have used the "site:" command on have shown nearly all of their cgi generated shopping cart pages.
I know G has been working hard on their spiders, and maybe I should just read forum 3 more often, but has this been discussed in depth?
Most of the pages currently have no PR, so I'm guessing this is something fairly new or they are just down in the heirarchy level far enough where they are < PR1.
I searched WW a bit, and didn't find much discussing this. I had seen discussions on G spidering Javascript now, but wondering if anyone could point me to discussions on CGI and SID spidering by G.
Anyhow, if anyone has flagged any good posts on the subject I would appreciate it.
One of my sites uses CGI for all its shopcart pages.
Some of the pages are over 6 years old. early last month I noticed these pages being spidered and indexed for the first time. They now show up in the serps and in froogle. it's funny but your post was the first one I have seen that mentioned this. I was kind of surprised no one else posted on this new (at least to my web site) spidering.
Most of the pages currently have no PR....
There're problems with the PR shown for dynamic pages.