Forum Moderators: phranque

Message Too Old, No Replies

HTML Code- Robots Revisit

revisit

         

Eriklange7

5:06 pm on May 30, 2003 (gmt 0)

10+ Year Member



What does this mean?

<meta name="revisit-after" content="15 days">
<meta name="ROBOTS" content="INDEX, ALL">
<meta name="distribution" content="global">
<meta name="ROBOTS" content="INDEX, ALL">
<meta name="ROBOTS" content="INDEX, FOLLOW">

or

<meta name="robots" content="ALL">
<meta name="revisit-after" content="7 days">

Should all sites have this type of info on their pages? I have ideas of course, but I would like someone who know what the are talking about to explain it to me! Thanks!

oilman

5:25 pm on May 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



for the most part all those tags are wasted html in my experience. The only useful tag is the no-cache tag for google if you don't want them to cache your page.

Revisit-after is my favorite one. There's not a bot on the planet that is going to come back to your site on your schedule.

I've never used any of those tags and all my page and links are indexed and followed no problem.

There are some tags that do come into play on occasion ie for BOBBY sites and other content rating systems etc but for the average everyday run of the mill website you don't need any of them.

If you want to control robots pretty much all you can do is tell them where NOT to go via robots.txt. For the rest of the time they will crawl your site and follow your links in their own sweet time.

Eriklange7

5:32 pm on May 30, 2003 (gmt 0)

10+ Year Member



Great...thanks!