joined:Feb 22, 2004
I am very new to robots and am not 100% sure what I need to do to make a very effective robot. This being not only the robot itself which I have read much on but also the metdescriptions on the index page. Now I am not sure because allot of the information I have read does not even speak of including a metadescription telling the index to follow the robot. Could someone clarify this for me and explain a little more as to what I should place in the index header for the bot. Also I was curious will all bots be allowed if I run a wildcard * instead of telling it to allow only specific bot types....