Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: goodroi
I have a directory and for each catagory there is a link (add url for each cat) I see that google is indexing this link for each catagory i.e www.mysite.com/dir/add_url.php?c=5
Is there a way to block each add url link from being indexed with robots txt without going through the whole site & copy pasting each url to my robots.txt file
Note that this will mean no version of add_url.php will appear in search results.