Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Is it possible to block file names beginning with a text string?

1:07 pm on Nov 10, 2013 (gmt 0)

Preferred Member

5+ Year Member

joined:Aug 30, 2007
posts: 555
votes: 3

In Robots.txt is it possible to block more than 1 file name beginning with the same text string?

wordpress creates a number of urls that I don't want indexed - such as the search pages...


The * represent various different and unique character strings.

Is it possible to block all beginning with >
8:07 am on Nov 11, 2013 (gmt 0)


WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
votes: 8

that's how it works in robots.txt - disallowed urls are matched left-to-right.