Forum Moderators: goodroi
I thought this would be good for search engine lists as it would only list my main index, but was a bit taken back when google listed one of my other pages ABOVE my main index in the search results!
I only want the main index listed and have today added meta name="robots" content="noindex,nofollow" to the header file to show on all pages but the index page. Do I need to add a robots.txt file, and if so will I have to list every page i.e as follows or what options do I have?
User-agent: *
Disallow: index.php?page=page2
Disallow: index.php?page=page3