Forum Moderators: phranque
<meta name="revisit-after" content="15 days">
<meta name="ROBOTS" content="INDEX, ALL">
<meta name="distribution" content="global">
<meta name="ROBOTS" content="INDEX, ALL">
<meta name="ROBOTS" content="INDEX, FOLLOW">
or
<meta name="robots" content="ALL">
<meta name="revisit-after" content="7 days">
Should all sites have this type of info on their pages? I have ideas of course, but I would like someone who know what the are talking about to explain it to me! Thanks!
Revisit-after is my favorite one. There's not a bot on the planet that is going to come back to your site on your schedule.
I've never used any of those tags and all my page and links are indexed and followed no problem.
There are some tags that do come into play on occasion ie for BOBBY sites and other content rating systems etc but for the average everyday run of the mill website you don't need any of them.
If you want to control robots pretty much all you can do is tell them where NOT to go via robots.txt. For the rest of the time they will crawl your site and follow your links in their own sweet time.