indyank - 11:27 am on Jun 28, 2013 (gmt 0)
as far as i know google does not index any 4xx status code responses.
Thanks phranque. Yes it shouldn't and that should be the right behavior.
But will it appear in the form of link only stubs in SERPS with a description that is similar to this one.
"A description for this result is not available because of this site's robots.txt – learn more. "
If it doesn't even show up in the SERPS, why does Google chose to show link only stubs for robots.txt excluded pages? The argument that those links are found on other sites, should hold good for password protected pages as well, isn't it?