Forum Moderators: goodroi

Message Too Old, No Replies

How to block original + localized pages?

robots.txt localized

         

vanguard2000

6:19 pm on Mar 17, 2008 (gmt 0)

10+ Year Member



Hi all,

I have a website that has localized pages in several languages. I'd like to block "static" directory since it's full of unstructured data which would raise the duplicate content flags. The URL structure is like this:

http://www.example.com/en/static/ (when your browser's lang is set to English)
and http://www.example.com/fr/static/ (when it's set to French) etc.

How do I block "static" properly?

Would this work?

Disallow: /*/static/

I have a feeling that it would block everything :) Hehe...

Any help is appreciated!