revisit-after tag

[dzinerbear]

Hi guys,

I'm just wondering if one can include the revisit-after information in the robots.txt file or is it still a good idea to include the meta tag in your html?

Thanks
Michael

[Mohamed_E]

revisit-after is not really very useful.

It tells the robot when you would like it to revisit. Somehow I feel that the robot does not really care, it revisits you when its algorithm wants to revisit.

[tedster]

Mohamed_E is correct - the meta tag does nothing for you. And there is no place in the robots.txt standard [robotstxt.org] that would allow for it. Adding it there would give you a non-standard file and lord knows what effect that might have on the crawler.

There's no help here -- we're just at the beck and call of the bots.