Forum Moderators: open

Message Too Old, No Replies

Strange Google Spidering Behavior

Anyone have ideas?

         

rbacal

3:55 am on Dec 5, 2003 (gmt 0)



Here's a puzzle. Brand new site and domain. Main page spidered and included in google about 1 week ago. Nothing else. The site is a directory type site that has an option to rate material, using a cgi script. Links for the rating script occur on each of the static directory pages.

Here's what's weird. Google spidered and included the RATE URL'S (which are dynamically generated by the script) but NOT any of the pages on which the rating links appear.

So, for example it included www.mydomain.com/cgi-bin/links/rate.cgi?ID=4833

but NOT the page on which that link would be found.

Anyone have any ideas about what this means? This is so strange that I'm not sure what question(s) to ask.

Explanations?