Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Quick Wordpress robots.txt question for Google SEO

12:23 am on Dec 22, 2012 (gmt 0)

Full Member from US 

5+ Year Member

joined:Feb 24, 2011
posts: 252
votes: 0

I was looking over my robot.txt tonight to make sure everything was ok (the programmer I had working for me and taking care of all this for three years quit because he got a full time job) - I am now checking on things and making sure everything is good.

I noticed this:

Disallow: /wp-content/cheader/

Is this something you want in your robot.txt ?

Why or why not?

Thanks in advance.
6:34 am on Dec 22, 2012 (gmt 0)

Junior Member

joined:Jan 9, 2012
posts: 192
votes: 0

wp-content/cheader is not a standard wordpress folder. Themes and plugins go their own folders, so you should probably investigate what that folder is about.

So since it's custom ("custom header"? ), maybe there's a good reason the programmer doesn't want google crawling it. Nobody can tell you either way, really.