| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
| 11:42 pm on Dec 2, 2002 (gmt 0)|
Hey there people
just have a general question. What is robots.txt and do we have to have robots.txt in our web hosting server?
| 11:44 pm on Dec 2, 2002 (gmt 0)|
Here's a good introduction:
| 9:50 am on Dec 3, 2002 (gmt 0)|
In my experience this is a file you would have to create yourself - no hosting company I have ever used has had a robots.txt file in place for me.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved