Forum Moderators: open

Message Too Old, No Replies

Will Google index these pages?

         

tbrown421

6:06 pm on Mar 28, 2003 (gmt 0)

10+ Year Member



I recently started using a script which uses an xml feed from Amazon. When someone clicks on a regular (not a java script) URL like <http://www.domain.com/cgi-bin/amazon.pl?type=browse&mode=books> they get a page which shows up in my cache for that script as something like <019642442c8e-c.tmp> (I have allowed the cgi-bin in robots.txt)

Question: Will Google look in my cgi-bin, then in the script cache and find all those .tmp pages?

Or, will it record each script-calling URL on the original physical page as a separate page?

Whew! I'm not a programmer, and I'm not sure I explained this correctly, but maybe someone will understand what I'm trying to ask. I HAVE been told that using a script like this will generate MANY pages for Google to index.

Thanks,
Tom

ginga

6:15 pm on Mar 28, 2003 (gmt 0)

10+ Year Member



Hi,

My take on this is for what it's worth is:

They won't index .tmp files. Why would they want to do that? If you have allowed access to your cgi-bin they should go in there and follow dynamic links so long as they don't contain a "SESSID" or an "ID" or anything that looks like a hash.

Perhaps you could hold the door open for googlebot a little by linking to individual dynamic pages from static pages on your site, using words relevant to the dynamic page in the link text (like the book title perhaps...)

The fact that there are probably a lot of Amazon affiliates around the web, all creating similar pages from the same XML feed, may also make your particular ones less interesting to the bot?