Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor
Quick Wordpress robots.txt question for Google SEO Frost_Angel msg:4530325 12:23 am on Dec 22, 2012 (gmt 0) I was looking over my robot.txt tonight to make sure everything was ok (the programmer I had working for me and taking care of all this for three years quit because he got a full time job) - I am now checking on things and making sure everything is good. I noticed this: Disallow: /wp-content/cheader/ Is this something you want in your robot.txt ? Why or why not? Thanks in advance.
klark0 msg:4530357 6:34 am on Dec 22, 2012 (gmt 0)
wp-content/cheader is not a standard wordpress folder. Themes and plugins go their own folders, so you should probably investigate what that folder is about. So since it's custom ("custom header"? ), maybe there's a good reason the programmer doesn't want google crawling it. Nobody can tell you either way, really.