Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies



11:42 pm on Dec 2, 2002 (gmt 0)

10+ Year Member

Hey there people
just have a general question. What is robots.txt and do we have to have robots.txt in our web hosting server?
11:44 pm on Dec 2, 2002 (gmt 0)

10+ Year Member

Not nescesarily.

Here's a good introduction:


9:50 am on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member blobfisk is a WebmasterWorld Top Contributor of All Time 10+ Year Member

In my experience this is a file you would have to create yourself - no hosting company I have ever used has had a robots.txt file in place for me.

Featured Threads

Hot Threads This Week

Hot Threads This Month