Forum Moderators: goodroi
User-agent: *
Disallow: /images
i believe that will stop them from indexing anything inside of the /images directory? also, could i simply put: Disallow: /images /adminstuff to have it block both directorys?
as for the robots meta tag...
i have a header.php, and obviously all of my index.php files call it, now... would it be redundant or would it cause any harm to have:
<META name="ROBOTS" content="INDEX, FOLLOW">
being that every time it hits a index.php, it would index that, as well as follow to index2.php, which it would them index and follow back to index.php being every page I have also has a link back to the main index.php?
if it sounds confusing let me know and ill try and explain it better.
i thank you for your time.
User-agent: *
Disallow: /images/
Disallow: /adminstuff/
As for the meta tag, I'd consider "index, follow" as redundant because that's the default behaviour so you could say nothing and achieve the same effect - but if you want to keep it there feel free because the only harm it will do is add an extra line to your source code.
- Tony