Stopping spiders indexing

[Karma]

Hi,

I have a few links on my site that take the visitor to input forms. I’d like to prevent these pages from being indexed/crawled.

Is there a way to stop individual links from being indexed/crawled from within the link code?

i.e

<A href="form.html" robots="noindex,nofollow">Add information</A>

I don’t think using the robots.txt file isn’t really an option as the form link is different for each page.

Thanks

[MichaelBluejay]

I'm pretty sure you can use robots.txt to disallow crawling of specific pages, but if not, you can for-sure disallow crawling of specific directories. You can put all the files you don't want crawled in there. I don't know whether putting the nofollow in the link will work, but you can always try it and see. Check your log files and see if bots are following those links or not.

[encyclo]

The syntax you suggest is invalid and won't work - to exclude the form, you will need to either specify the form page in your robots.txt, or you need to use a meta robots tag on the form page which disallows indexing of the page:

<meta name="robots" content="noindex">

There is the

rel="nofollow"

attribute, but that doesn't stop indexing, it merely acts as an indicator that the linked page is not trusted by the linking page.