googlebot and links

missed this months index

[ill_man]

I'm really concerned with making sure this site gets indexed on the next round so I wonder if I could get your feedback.

I hid a plain old explicit href link, on a single pixel .gif on the default page, linking to a page just for the bots which directs them past some form-based obstacles to the product info I want indexed.

Googlebot has been to the default site page 30 times since Thursday, but he didn't once go to the hidden bot page. And the current cached page at google has been updated over the weekend to a copy from Feb, 8.

Is the problem the "hidden" link, Does googlebot ignore a link on a single pixel .gif?

Or is the problem that it's an explicit link, which depending upon which URL used to get there could look like a link to an outside resource even though it resolves to the same IP?

Additionally, once googlebot gets to the bot_only.asp page, will he follow the links from there if they include a querystring param? (mysite.com/page.asp?id=xxx)

[jimbeetle]

Hi ill_man,

To answer the last question first: Sure, without too many parameters Google should be able to follow the links.

To get back to the first part. If possible, why not just use a text link such as "Site Map" or "Browse a Full List of Products." Anything hidden will eventually cause problems, if not by the SEs themselves, by somebody reporting the site.

Jim

[ill_man]

The problem is that I don't want humans to find this link since it circumvents the site flow that forces them to set filters in place, preventing them from seeing/buying products that don't fit their car.

I need to create a way for the spiders to get past those filters.

You see my problem?

[jdMorgan]

ill_man,

You might want to consider using a server redirect to bypass your "login" stuff based on IP address or User-agent. While it is technically cloaking, it is not cloaking with intent to mislead.

I'd also advise getting feedback from members here who have done this or tried to do this before you do it yourself. I have not tried it, and cannot vouch for its safety. There may be other ways to accomplish what you need to do without the possible risks associated with cloaking - they're just not apparent to me.

Jim