Forum Moderators: open

Message Too Old, No Replies

robot meta tag

robot meta tag

         

bobbot

9:31 am on May 8, 2006 (gmt 0)

10+ Year Member



I Wish to block my text only version of pages with the robot metatag below for all search engines.

<META NAME="robots" CONTENT="nofollow,noindex" />

I though the robots attribute took care of all bots. However I am starting to see it replaced with msnbot and googlebot. Does robots still cover msn, google and yahoo or do they need to be individually specified.

Hope this makes sense.

By the way can't use robot.txt because I do not have access.

encyclo

4:25 pm on May 8, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If you want to block all conforming robots, then you should use the version you have now. If you want to specifically block a particular search engine spider then you can specify it in the place of the "robots".