How to stop googlebot from crawling a link

but crawl another, on the same page

[leifwessman]

I have a dynamic website. URL:s look like this

www.domain.com/widget1.php
www.domain.com/widget2.php
...
www.domain.com/widget99.php
www.domain.com/widget100.php

Each page has a different view. To access this view there is a link on every page like this:

On the page widget1.php there is a link to
widget1.php?view=0

How can I stop googlebot from following these links? I can't use robots.txt since I have more than 5000 pages. I can't use <meta> tags, since I want google to follow the rest of the links on the page.

I guess one solution is to append more arguments to the url. Google will then not follow (becaus it only follows if one or two arguments). That solution works, but it's not so beautiful.

Does anyone else have a clue?

Leif

[swizz]

Hi leifwessman,

how about with javascript <a href="#" onclick=javascript:redir()...

/SwiZZ

[outrun]

As I understand it you want to crawl the pages not the links, maybe this is what you want, put this in your head tags at the start

<meta name="robots" content="index,nofollow">

<added> Or if thats not what you want, you can alter your widget1.php to widget100.php so that if they pass a variable to echo or print
<meta name="robots" content="noindex,nofollow">
in the head tags.
</added>

regards,
Mark

[planbeta]

Not sure but I think the main reason google doesn't like dynamic urls is because of things like session id's, which lead to spidertraps.

Why not set up your urls with this in mind.

Like I said I'm not sure so if someone else knows any better please feel free to expand on this ;)

Chris

[shaadi]

I would go with swizz