Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: bakedjake
I have updated my robots file to cut out the non text pages, yet this bot doesn't obey it. Is there something wrong with my file? Or is there some way to beat the bot into submission?