New Forum : Robots.txt

[Brett_Tabke]

Welcome to the new robots.txt forum. As you can see, we had just a "few" posts laying around on the subject.

note: specific robot behavior with regard to robots.txt should go in that parent forum. (eg: q's about googlebot should go in the google forum)