Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Block specific part of the site


mseo - 3:42 pm on Nov 23, 2010 (gmt 0)


I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site;

subdomain.com/language_id/content_url

We have about 40 subdomains and same ammount of language id's.


Thread source:: http://www.webmasterworld.com/robots_txt/4234068.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com