Forum Moderators: open

Message Too Old, No Replies

How good is <META NAME=ROBOTS>?

         

brucec

12:08 pm on May 7, 2004 (gmt 0)

10+ Year Member



I started using this meta tag, but is it any good like:

<meta name="robots" content="all,index,follow">

Elijah

12:43 pm on May 7, 2004 (gmt 0)

10+ Year Member



I don't think it's worth using unless you are telling the robots to stay away.
They will come without you telling them that they are welcome. ;)

jetboy_70

12:54 pm on May 7, 2004 (gmt 0)

10+ Year Member



Either
<meta name="robots" content="all">
or
<meta name="robots" content="index,follow">

Both do the same thing. This became prevalent when we found out that Inktomi's default behaviour was not to follow - but it shouldn't be necessary any more.

This doesn't necessarily mean you shouldn't use it though. After all, the meta keywords element was considered to be as good as dead until Yahoo started using it again. Consider it a safeguard against future developments.