block all except - Sitemaps, Meta Data, and robots.txt forum at WebmasterWorld - WebmasterWorld

Forum Moderators: goodroi

Message Too Old, No Replies

block all except

Radial

2:53 pm on Jul 7, 2005 (gmt 0)

10+ Year Member

Hi
i want to block all except Google, Yahoo and MSN is this possible?

Dijkgraaf

9:31 pm on Jul 7, 2005 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Yes.

User-agent: googlebot
Disallow:

User-agent: slurp
Disallow:

User-agent: msnbot
Disallow:

User-agent: *
Disallow: /