-- Google SEO News and Discussion
---- page is noindexed, but still shows in SERP with a Google notice
- 12:17 am on Jun 30, 2013
Assuming that the bot reads and obeys the robots.txt before it visits each page. Including when following inbound links.
Which the bots do not do...
to which bots are you referring?
it's either a "well-behaved bot" or it's not respecting the robots exclusion.
robots.txt is irrelevant to "inbound links" - it is purely about the impending request.
Brought to you by