Forum Moderators: goodroi
Specifically, like this:
www.widgets.com/page.php?operation=printablepage
where "operation=printablepage" is the trigger to disallow.
Can this be done?
Whilst you might get some of the advanced SE bots to understand a complex robots.txt, I personally think it is better avoided in this case.
This script makes url's like this one:
[exampleURL.com...]
where the id changes number from page to page.
I have no idear of how to make this refer a friend script automatically insert a nofollow - no index tag.
Is excluding these pages from search engines within the robots.txt not possible?
Any help would be much appreciated.
Thanks in advance