Welcome to WebmasterWorld Guest from 54.167.216.93

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt

robots.txt

     
11:42 pm on Dec 2, 2002 (gmt 0)

10+ Year Member



Hey there people
just have a general question. What is robots.txt and do we have to have robots.txt in our web hosting server?
thanks
sunny
11:44 pm on Dec 2, 2002 (gmt 0)

10+ Year Member



Not nescesarily.

Here's a good introduction:

[searchengineworld.com...]

9:50 am on Dec 3, 2002 (gmt 0)

WebmasterWorld Senior Member blobfisk is a WebmasterWorld Top Contributor of All Time 10+ Year Member



In my experience this is a file you would have to create yourself - no hosting company I have ever used has had a robots.txt file in place for me.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month