Welcome to WebmasterWorld Guest from 54.226.242.132

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Quick Wordpress robots.txt question for Google SEO

     
12:23 am on Dec 22, 2012 (gmt 0)

Full Member from US 

5+ Year Member

joined:Feb 24, 2011
posts: 252
votes: 0


I was looking over my robot.txt tonight to make sure everything was ok (the programmer I had working for me and taking care of all this for three years quit because he got a full time job) - I am now checking on things and making sure everything is good.

I noticed this:

Disallow: /wp-content/cheader/

Is this something you want in your robot.txt ?

Why or why not?

Thanks in advance.
6:34 am on Dec 22, 2012 (gmt 0)

Junior Member

joined:Jan 9, 2012
posts: 192
votes: 0


wp-content/cheader is not a standard wordpress folder. Themes and plugins go their own folders, so you should probably investigate what that folder is about.

So since it's custom ("custom header"? ), maybe there's a good reason the programmer doesn't want google crawling it. Nobody can tell you either way, really.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members