Page is a not externally linkable
- Hardware and OS Related Technologies
-- Website Technology Issues
---- The <head> Cascade and Robots META Tags


pageoneresults - 7:10 pm on Sep 15, 2008 (gmt 0)


The above example would be open to interpretation which could differ between bots.

Therein lies my concern. If programming a bot I'd be following the rules of engagement in regards to the cascade. But, this is a Robots Directive and I'm 50/50.

Would it stop at the first directive and go no further?

Or, would it continue to index the entire <head></head> and honor the second directive which would override the first from a cascading perspective?

Bets? ;)

A little OT, I can confirm that G does not honor noindex, nofollow, noarchive. All three directives combined in that sequence. It will noarchive.


Thread source:: http://www.webmasterworld.com/website_technology/3745082.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com