Forum Moderators: bakedjake
But please tolerate a total novice at the webmaster game. (Only doing it out of necessity)
I've read much on the robot.txt file.
But what I'm unsure of is this...
1) Do I just make a file called "Robots.txt" and put it in the root of my domain directory?
2) I can't find a complete code example of this file. I only want to kill the alexa rating data and I have no clue what to "program" in this file.
Thanks and I apologize for being a complete moron.
User-agent: ia_archiver
Disallow: /
Place the file in your root directory. Do a search for robots.txt validation and you can verify that what you've done is correct.
The previously referenced thread offers more insight into what will/won't/is supposed to happen.
Best Wishes
If you need to know something, chances are very good that it has already been discussed thoroughly multiple times on WebmasterWorld. So all you need to do is search WW with google.
For example, add this into the search bar in google then press search:
site:webmasterworld.com blocking Alexa
which will give you the following URL and relevant posts.
[google.ca...]
Cheers, now you can teach yourself everything just by searching WW. If all else fails, then a quick post will usually do the trick.
You can find complete robots.txt just by putting in the URL. eg. [webmasterworld.com...]