Welcome to WebmasterWorld Guest from 54.145.58.37

Forum Moderators: goodroi

Message Too Old, No Replies

Is this valid? wildcard in robots

Disallow: /*/edit.html

     
1:56 pm on Apr 18, 2008 (gmt 0)

New User

5+ Year Member

joined:Mar 20, 2008
posts: 21
votes: 0


User-agent: *
Disallow: /*/edit.html
Disallow: /*/report.html

-------------------------
I have many pages with this format. where the number is an ID
www.example.com/999/report.html

10:14 am on Apr 20, 2008 (gmt 0)

New User

5+ Year Member

joined:Apr 20, 2008
posts:5
votes: 0


this is my first i saw robots.txt like this
User-agent: *
Disallow: /*/edit.html
Disallow: /*/report.html

may you can try to use this in normal format

1:47 pm on Apr 20, 2008 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3120
votes: 111


what you are using is called wildcards or pattern matching. and basically it is telling the search engines not to index and file that has that sequence of character in it. the big search engines support this.

it is not technically valid. the robots.txt protocol does not support wildcards (pattern matching). this means that the other bots will not probably be able to support this.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members