Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Block specific part of the site

3:42 pm on Nov 23, 2010 (gmt 0)

I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site;


We have about 40 subdomains and same ammount of language id's.
5:19 pm on Nov 29, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

hi mseo and welcome to webmasterworld!

are you just trying to block the launguae_id folder?

User-agent: *
Disallow: /language_id/
12:53 am on Nov 30, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member

And you will need to put that in the robots.txt in the root folder of each sub domain.

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month