Welcome to WebmasterWorld Guest from 54.242.9.97

Forum Moderators: goodroi

Message Too Old, No Replies

Fav icon and robots.txt

Do I need these?

     
2:45 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


I was looking thru my error log file and found lots of messages referencing these two files? Do I really need these? If I do, where can I go to learn more about them? Thanks.
2:47 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 21, 2003
posts:2355
votes: 0


favicon.com/

robotstxt.org/wc/robots.html

2:56 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Robots.txt for sure....

Favicon is optional but cool

3:01 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


Why do I need robots.txt? What does it do? Do you have a sample code of a typical file?
3:09 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Check this out also. All the info you need is here
from Search Engine World [searchengineworld.com]
3:34 pm on Aug 12, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 13, 2003
posts:158
votes: 0


Thanks. Has it hurt my site not having the robots file?
3:49 pm on Aug 12, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 27, 2002
posts:1187
votes: 0


Not a big problem, but good practice. Check out other threads on this board for robots to disallow. Lots of great stuff here.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members