Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
6:40 pm May 15, 2026
This page requires javascript.
Forum Moderators:
goodroi
Message Too Old, No Replies
Block specific part of the site
mseo
Msg#:4234070
3:42 pm on Nov 23, 2010
(gmt 0)
I was wondering if any of you guys know how to use robots.txt file to block acces to a specific portion of a site;
subdomain.com/language_id/content_url
We have about 40 subdomains and same ammount of language id's.
goodroi
Msg#:4236343
5:19 pm on Nov 29, 2010
(gmt 0)
hi mseo and welcome to webmasterworld!
are you just trying to block the launguae_id folder?
User-agent: *
Disallow: /language_id/
Dijkgraaf
Msg#:4236510
12:53 am on Nov 30, 2010
(gmt 0)
And you will need to put that in the robots.txt in the root folder of each sub domain.
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Apr
,
Mar
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
May 2026 Google Search Observations
AdSense Earnings and Observations - May 2026
Page indexed but live url test gets 500 error
Microsoft, AS8075. Google, AS396982.
Bad actor claiming to be OpenAi
in case you missed it .
Country Removal notice from Google Search
Best Learning Path for a Web Development Beginner?
SEO question
April 2026 Google Search Observations
Home
Forums Index
General SEO Issues
/
Sitemaps, Meta Data, and robots.txt
6:40 pm May 15, 2026