Welcome to WebmasterWorld Guest from 54.196.231.129

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt

robots.txt

     
11:42 pm on Dec 2, 2002 (gmt 0)

Full Member

10+ Year Member

joined:Dec 1, 2002
posts:221
votes: 0


Hey there people
just have a general question. What is robots.txt and do we have to have robots.txt in our web hosting server?
thanks
sunny
11:44 pm on Dec 2, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 26, 2002
posts:402
votes: 0


Not nescesarily.

Here's a good introduction:

[searchengineworld.com...]

9:50 am on Dec 3, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member blobfisk is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 25, 2002
posts:3185
votes: 0


In my experience this is a file you would have to create yourself - no hosting company I have ever used has had a robots.txt file in place for me.