Welcome to WebmasterWorld Guest from 54.159.50.111

Forum Moderators: goodroi

Message Too Old, No Replies

Fav icon and robots.txt

Do I need these?

     
2:45 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


I was looking thru my error log file and found lots of messages referencing these two files? Do I really need these? If I do, where can I go to learn more about them? Thanks.
2:47 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 21, 2003
posts:2355
votes: 0


favicon.com/

robotstxt.org/wc/robots.html

2:56 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Robots.txt for sure....

Favicon is optional but cool

3:01 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


Why do I need robots.txt? What does it do? Do you have a sample code of a typical file?
3:09 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Check this out also. All the info you need is here
from Search Engine World [searchengineworld.com]
3:34 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


Thanks. Has it hurt my site not having the robots file?
3:49 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Not a big problem, but good practice. Check out other threads on this board for robots to disallow. Lots of great stuff here.