I was looking over my robot.txt tonight to make sure everything was ok (the programmer I had working for me and taking care of all this for three years quit because he got a full time job) - I am now checking on things and making sure everything is good.
I noticed this:
Is this something you want in your robot.txt ?
Why or why not?
Thanks in advance.