Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Google cached my robots.txt file


MHes - 8:38 am on Jan 30, 2007 (gmt 0)


We have robots.txt indexed as well and it happenned 5 days before we got hit by the 950 penalty (22 Dec). At the time, it was listed as our number1 page on a site:search, though this may have been meaningless. Since then it went supplemental. I'm not sure if Google stopped obeying it during that time but previously (and for many years) we had disallowed pages listed as urls only when doing a site:search, then they just disappeared and have only just returned back to normal.

I'm beginning to wonder if all this was and is related to the 950 penalty. Many members reported having their supplementals listed above their main pages when first hit by 950 penalty.... I wonder how many have a robots.txt indexed as well?


Thread source:: http://www.webmasterworld.com/google/3234479.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com