If I'm allowed to use someone else's content but I don't want a dup cont. penalty is there some robots tag I can put in my HTML to stop the spiders from indexing it and my site getting a penalty?
Derek
MatthewHSE
10:51 pm on Sep 8, 2005 (gmt 0)
There sure is:
<meta name="robots" content="noindex,nofollow">
Alternatively, you could exclude those pages from being crawled in your robots.txt file.
