I have a website which translated into many languages including Traditional and Simplified Chinese.
As we know that Traditional chinese would be widely use in Hong Kong and Simplified is mainly used in China itself.
Baidu search engine is only support Simplified Chinese font character and will automatically translated my Traditional chinese website into Simplified.
This is why Baidu consider my these 2 sites as a Duplicate content which it's actually not. Baidu is now dropping my Simplified site instead of Traditional which I think it should be vice versa.
They also stop crawling Simplified site as well as reduce pages indexed to 4 results!
So since I want my Simplified site to be recognized by Chinese internet user in China which using Baidu as a main search engine, so I'm thinking of blocking Baidu spider from crawling my Traditional site so they would turn into the Simplified instead.
My question is how to block this Baidu spider since I've heard somewhere that they don't obey the robots.txt command.
Any suggestion.... please help.