Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: phranque
<meta content="noindex, nofollow" name="robots" />
<meta content="index, follow" name="robots" />
Would I be correct in taking an educated guess at the above implementation and stating that the bot will index and follow the page containing the above sequence of elements?
In practice they don't
Or rather, in practice Google don't. But what about the others? Live, Yahoo, etc.? As there is no real, formal "standard" either for robots.txt or for meta robots elements, the above example would be open to interpretation which could differ between bots.
The above example would be open to interpretation which could differ between bots.
Therein lies my concern. If programming a bot I'd be following the rules of engagement in regards to the cascade. But, this is a Robots Directive and I'm 50/50.
Would it stop at the first directive and go no further?
Or, would it continue to index the entire <head></head> and honor the second directive which would override the first from a cascading perspective?
A little OT, I can confirm that G does not honor noindex, nofollow, noarchive. All three directives combined in that sequence. It will noarchive.