Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: goodroi
I have three URL patterns
I want allow users to crawl the first two but not to allow the links following it. I have to disallow the third pattern.
Basically it is allowing the first page and disallow the second page.
How can i do this in robots.txt?