homepage Welcome to WebmasterWorld Guest from 54.226.173.169
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Quick Wordpress robots.txt question for Google SEO
Frost_Angel




msg:4530325
 12:23 am on Dec 22, 2012 (gmt 0)

I was looking over my robot.txt tonight to make sure everything was ok (the programmer I had working for me and taking care of all this for three years quit because he got a full time job) - I am now checking on things and making sure everything is good.

I noticed this:

Disallow: /wp-content/cheader/

Is this something you want in your robot.txt ?

Why or why not?

Thanks in advance.

 

klark0




msg:4530357
 6:34 am on Dec 22, 2012 (gmt 0)

wp-content/cheader is not a standard wordpress folder. Themes and plugins go their own folders, so you should probably investigate what that folder is about.

So since it's custom ("custom header"? ), maybe there's a good reason the programmer doesn't want google crawling it. Nobody can tell you either way, really.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved