Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies



11:42 pm on Dec 2, 2002 (gmt 0)

Full Member

10+ Year Member

joined:Dec 1, 2002
votes: 0

Hey there people
just have a general question. What is robots.txt and do we have to have robots.txt in our web hosting server?
11:44 pm on Dec 2, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 26, 2002
votes: 0

Not nescesarily.

Here's a good introduction:


9:50 am on Dec 3, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member blobfisk is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 25, 2002
votes: 0

In my experience this is a file you would have to create yourself - no hosting company I have ever used has had a robots.txt file in place for me.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members