why use and what is robots.txt

this maybe stupid question

[mick_simon]

this maybe stupid question

Hi everyone I stubble on this section of the forum, I have no about robo.txt and also it mention robo.text is good SEO can any body explain

And were can I find more beginner information

Thank you

[coopster]

No such thing as a stupid question, my friend!

Near the top of the page for every forum here at WebmasterWorld you will find some links to the Forum Charter and the Forum Library that you are viewing. This forum is no different and you will find quite a bit of introductory information regarding robots.txt in the robots.txt forum Charter [webmasterworld.com]

[pageoneresults]

These days I might be a bit leery about using my robots.txt for too much. No, I'm more apt to do something a bit more technical and not put a directory list in there for prying eyes to see. Especially Googlebot and it's damn URI only listings for references discovered via the robots.txt file.