Welcome to WebmasterWorld Guest from 54.163.100.58

Forum Moderators: goodroi

Block specific part of the site

   
3:42 pm on Nov 23, 2010 (gmt 0)



I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site;

subdomain.com/language_id/content_url

We have about 40 subdomains and same ammount of language id's.
5:19 pm on Nov 29, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



hi mseo and welcome to webmasterworld!

are you just trying to block the launguae_id folder?


User-agent: *
Disallow: /language_id/
12:53 am on Nov 30, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



And you will need to put that in the robots.txt in the root folder of each sub domain.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month