Welcome to WebmasterWorld Guest from 23.22.220.37

Forum Moderators: rogerd & travelin cat

Message Too Old, No Replies

WordPress robots.txt

How to add to the dynamically created

     
8:10 pm on Dec 18, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member henry0 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 19, 2003
posts: 4388
votes: 2


Am I correct to assume that WP dynamically generates a simple robots.txt file?
If I enter my site URL and add "/robots.txt it shows up in a form disallowing admin and includes.
I have a few more dirs to disallow but cannot find it.
What can I do, upload a new one at root level and expect that it will override the dynamic one?
11:32 pm on Dec 18, 2013 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10542
votes: 8


the typical WordPress internal rewrite will be preceded by a file existence check so that should work.
12:24 am on Dec 19, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lorax is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Mar 31, 2002
posts:7575
votes: 0


Yup it does and yes you can. You may want to see this post on WordPress.org: [wordpress.org...]
1:52 pm on Dec 19, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member henry0 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 19, 2003
posts: 4388
votes: 2


Thanks, I am learning my way!

<edit> addendum.
Good read from the link
</edit>
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members