Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

How to block original + localized pages?

robots.txt localized

6:19 pm on Mar 17, 2008 (gmt 0)

New User

5+ Year Member

joined:Oct 29, 2007
posts: 11
votes: 0

Hi all,

I have a website that has localized pages in several languages. I'd like to block "static" directory since it's full of unstructured data which would raise the duplicate content flags. The URL structure is like this:

http://www.example.com/en/static/ (when your browser's lang is set to English)
and http://www.example.com/fr/static/ (when it's set to French) etc.

How do I block "static" properly?

Would this work?

Disallow: /*/static/

I have a feeling that it would block everything :) Hehe...

Any help is appreciated!


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members