Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: goodroi
I see robots.txt discussed in posts but I don't know what this is. I assume meta robot tag is not robot.txt.
I really hope this isn't too dumb a question from a learner/student etc.
all the best
A Google search for robots.txt will explain all. It is a fairly complex subject and not really worth replicating in this forum as an good site exists for that purpose ;)
Amazing that site has a PR9 for such a diverse subject....food for thought!