Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

How to block original + localized pages?

robots.txt localized



6:19 pm on Mar 17, 2008 (gmt 0)

5+ Year Member

Hi all,

I have a website that has localized pages in several languages. I'd like to block "static" directory since it's full of unstructured data which would raise the duplicate content flags. The URL structure is like this:

http://www.example.com/en/static/ (when your browser's lang is set to English)
and http://www.example.com/fr/static/ (when it's set to French) etc.

How do I block "static" properly?

Would this work?

Disallow: /*/static/

I have a feeling that it would block everything :) Hehe...

Any help is appreciated!


Featured Threads

Hot Threads This Week

Hot Threads This Month