Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: goodroi
I have three URL patterns
I want allow users to crawl the first two but not to allow the links following it. I have to disallow the third pattern.
Basically it is allowing the first page and disallow the second page.
How can i do this in robots.txt?