Forum Moderators: goodroi

Message Too Old, No Replies

Fav icon and robots.txt

Do I need these?

         

spikedo55

2:45 pm on Aug 12, 2003 (gmt 0)

10+ Year Member



I was looking thru my error log file and found lots of messages referencing these two files? Do I really need these? If I do, where can I go to learn more about them? Thanks.

bcolflesh

2:47 pm on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



favicon.com/

robotstxt.org/wc/robots.html

jbinbpt

2:56 pm on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Robots.txt for sure....

Favicon is optional but cool

spikedo55

3:01 pm on Aug 12, 2003 (gmt 0)

10+ Year Member



Why do I need robots.txt? What does it do? Do you have a sample code of a typical file?

jbinbpt

3:09 pm on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Check this out also. All the info you need is here
from Search Engine World [searchengineworld.com]

spikedo55

3:34 pm on Aug 12, 2003 (gmt 0)

10+ Year Member



Thanks. Has it hurt my site not having the robots file?

jbinbpt

3:49 pm on Aug 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Not a big problem, but good practice. Check out other threads on this board for robots to disallow. Lots of great stuff here.