Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

what is robots.txt file?



5:48 am on Jan 4, 2003 (gmt 0)

10+ Year Member

Hello again (my 2nd post) and a comment that this is a terrific site for professional info. However, sometimes a tad too professional because everyone seems to talk in acronyms (illegal in medicine and nursing circles ya know).

I see robots.txt discussed in posts but I don't know what this is. I assume meta robot tag is not robot.txt.

I really hope this isn't too dumb a question from a learner/student etc.

all the best


5:56 am on Jan 4, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member


Welcome to WebmasterWorld [webmasterworld.com]!

Here's a good robots.txt tutorial [searchengineworld.com] from WebmasterWorld's sister site to get you started.



5:57 am on Jan 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Hi antipodes,

A Google search for robots.txt will explain all. It is a fairly complex subject and not really worth replicating in this forum as an good site exists for that purpose ;)

Amazing that site has a PR9 for such a diverse subject....food for thought!


Featured Threads

Hot Threads This Week

Hot Threads This Month