shaunm - 11:04 am on Aug 31, 2012 (gmt 0)
I have blocked some of my website pages through robots.txt. Now I see that some of them are indexed while some are not. I am confused as I don't get the point in indexing pages that has been blocked in robots.txt
Can you please suggest? Or adding the noindex html tags in pages that I don't want to be indexed will do the trick?
Thanks a lot!