Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: goodroi
for example, have a site in japanese, korean, german and french. i only want google to spider the japanese pages and not the others. how would i write the robot file? can i allow/disallow by using the charset code (assumming they are not all unicode that is) or the html lang = line?