Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
for example, have a site in japanese, korean, german and french. i only want google to spider the japanese pages and not the others. how would i write the robot file? can i allow/disallow by using the charset code (assumming they are not all unicode that is) or the html lang = line?