Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google Index robots.txt


webseosolution - 7:24 am on Aug 24, 2012 (gmt 0)


Hello,

I have Blocked some of my web urls through robots.txt before a few months. But If I am checking it now it delivers the message like:

A description for this result is not available because of this site's robots.txt

And the urls are accessible through google search, What will be the best way to stop them being indexed?
As those urls have some important data in PDF or PDA that should be only available for paid members only.

Please let me know how can I remove them google indexing?

If I will try google webmaster tool to remove them for each and every url it will take too long as the count for those urls is more then 500.

Is there any other way apart from google webmastaer removal tool?

Thanks & Regards,
WSS


Thread source:: http://www.webmasterworld.com/robots_txt/4487907.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com