Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Why Google Might "Ignore" a robots.txt Disallow Rule


Brett_Tabke - 2:10 pm on Aug 17, 2006 (gmt 0)


> It's the only interpretation that works logically, isn't it?

no. Some bots have worked in the past in increasing order of importance. What comes last in the robots.txt trumps what comes first. A sequential reading of robots.txt is how Infoseek and Scooter used to work.

[edited by: Brett_Tabke at 4:23 pm (utc) on Aug. 19, 2006]


Thread source:: http://www.webmasterworld.com/google/3044757.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com