Forum Moderators: mack

Message Too Old, No Replies

favicon. ico and robots. txt

         

brijay

11:53 pm on Mar 1, 2005 (gmt 0)

10+ Year Member



Have spotted in my failures reports
/favicon.ico
and /robots.txt in high numbers

Is this a concern i have not set up either is that going to affect any ratings ect.
I have on each page a robot tag set as follows-
<META NAME="robots" CONTENT="index, follow">
this is in the head section just below the title tag

Will I still be getting indexed properly with just this or is a robots.txt file important. I do not at this stage have limitations that I want on the robots so felt it wasn't necessary for the robot.txt file

quadcity

1:43 am on Mar 2, 2005 (gmt 0)

10+ Year Member



Hello brijay.
>Will I still be getting indexed properly
Yes, it will cause no problems.

P.S.
META NAME="robots" CONTENT="index, follow"
index, follow is the default behavior, so that meta tag is not needed. (It's is causing no problems.)

ncw164x

2:02 am on Mar 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You can have a blank robots.txt file to eliminate the 404 errors from your log file, the reason you are seeing them is the spider has requested the file but its not available

Solution = place a blank robots.txt file in the root directory of your web site

Open notepad and save the empty file as robots.txt
FTP to your root web space and upload the file in ASCII mode

This also applies to the favicon.ico, because you have not got one each time its requested it puts a 404 error in the log file.

Solution = make a favicon and place it in the root directory of your web site

do a search for software to make your favicon, forum rules don't allow the posting of web addresses