Page is a not externally linkable
-- Google SEO News and Discussion
---- page is noindexed, but still shows in SERP with a Google notice
phranque - 11:27 pm on Jun 30, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/google/4588243.htm
have you verified that all preceding requests for robots.txt also got a 200 OK response?
and there's no chance that robots.txt was modified such that the /merchant/ directory was not excluded at some point?
Brought to you by WebmasterWorld: http://www.webmasterworld.com