| Block specific part of the site
|
mseo

msg:4234070 | 3:42 pm on Nov 23, 2010 (gmt 0) | I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site; subdomain.com/language_id/content_url We have about 40 subdomains and same ammount of language id's.
|
goodroi

msg:4236343 | 5:19 pm on Nov 29, 2010 (gmt 0) | hi mseo and welcome to webmasterworld! are you just trying to block the launguae_id folder? User-agent: * Disallow: /language_id/
|
Dijkgraaf

msg:4236510 | 12:53 am on Nov 30, 2010 (gmt 0) | And you will need to put that in the robots.txt in the root folder of each sub domain.
|
|
|