Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Is it possible to block file names beginning with a text string?



1:07 pm on Nov 10, 2013 (gmt 0)

5+ Year Member

In Robots.txt is it possible to block more than 1 file name beginning with the same text string?

wordpress creates a number of urls that I don't want indexed - such as the search pages...


The * represent various different and unique character strings.

Is it possible to block all beginning with >


8:07 am on Nov 11, 2013 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

that's how it works in robots.txt - disallowed urls are matched left-to-right.

Featured Threads

Hot Threads This Week

Hot Threads This Month