Forum Moderators: open

Message Too Old, No Replies

Is there a definitive way to tell if G will crawl an indirect link?

They crawl the Yahoo directory indirect links

         

alpine

5:40 pm on May 30, 2004 (gmt 0)

10+ Year Member



I thought it was clear that Googlebot would not crawl URLs in the format that the Yahoo directory has. Google clearly crawls Yahoo's directory links, as one can do a backlinks check and see Yahoo directory links.

I recently asked how this can be; Google should choke on the URL structure. Someone postulated to me that Yahoo cloaks the page for browsers, but shows clean URLs to spiders. A check of the cache shows this not to be.

Another person explained that the links are 302ed to the actual page. A check shows this to be true. Great answer, but I have some resulting questions:

1) How does G ever see the 302, since it should look at the URL structure and say "no thanks"?

2) I have found other directories that similarly give a 302 for indirect links, but seemingly do not pass PR and link text credit.

Is there a definitive way to tell if an indirect link will be valued?

ALbino

7:23 pm on May 30, 2004 (gmt 0)

10+ Year Member



My site has lots of visible backlinks that use redirect scripts. I think Google fixed this problem (or at least tweaked it) a long time ago.

zgb999

2:09 pm on May 31, 2004 (gmt 0)

10+ Year Member



The only definitive way I know of is to go to page X that uses those redirects and check some pages it links to to see whether page x shows up as backlink.