Will googlebot crawl this redirect URL for the Yahoo Directory?

[johnlim9988]

Dear All,

I believe the following example URL is an URL redirect. yes?

http://us.rd.yahoo.com/dir/catpg/bp2/*http://dir.yahoo.com/Keyword1/Keyword2/Keyword3/Keyword4/?b=20

Will googlebot crawl such kind of pages?

Thanks.

[edited by: tedster at 5:38 am (utc) on Aug. 8, 2007]
[edit reason] replace actual keywords in url [/edit]

[tedster]

There are several questions here:

1. Will the full URL be crawled?
-- Yes, if the link appears on a page where it is allowed to be spidered. But note that a Google search on site:us.rd.yahoo.com returns no results.

2. Will the final, redirected URL be indexed?
-- Do a Google search for site:dir.yahoo.com/Keyword1/Keyword2/Keyword3/Keyword4/ and you'll see many pages from this part of Yahoo's Directory in the Google index. The query string at the very end is another question.

I don't know whether Google is getting that kind of Yahoo Directory page through the redirect (which is a 302, not a 301), or through a different kind of link, somewhere else on Yahoo. But if your basic question is does Google index the Yahoo Directory -- then yes, they definitely do.

[johnlim9988]

But the yahoo directoy page has no cache, no index.......

[johnlim9988]

I am not mean the fist yahoo directory page, I mean the 2nd yahoo directoy page and so on...You can check from yahoo directoy page then you will find this problem....

Thanks.

[johnlim9988]

Hi,

The page [dir.yahoo.com...]

Is not cashed and not indexed.

As if you do a search

site:dir.yahoo.com/Entertainment/Music/Artists/By_Genre/Classical/Composers/20th_Century_and_Contemporary/Modern/

Then you will see 21 pages, but not include [dir.yahoo.com...]

I found the problem is that if it is too deep then googlebot cannot so deep with?b=20 etc...

[johnlim9988]

Anybody has any new ideas?

Thanks.

[luvdavy]

Link to the Yahoo page from some other sites or on your blog several times. That will get it indexed.
It may help you a little bit even with very low or no PR...just because they consider it an authority vote.

Jan

[johnlim9988]

The page as I said is really not cashed or indexed by google.

Is it useful to list in yahoo in such kind of page?

Thanks.

[tedster]

Yes, especially if you follow the advice that luvdavy gave you above about a link. That will help Google to index the page. I've also often found that Yahoo editors will take care of you and make sure that the entry gets on other appropriate pages in their directory after you submit to one.