Giving Yahoo's bot exclusive acess - (deprecated) Yahoo SE and Directory forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

Giving Yahoo's bot exclusive acess

tomequin

9:40 pm on Jul 1, 2004 (gmt 0)

10+ Year Member

Hi. Is there a way I can stop Google or some other bot from crawling a site and still allow Yahoo to crawl?
Thanks.

WebGuerrilla

6:08 pm on Jul 2, 2004 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

put this in your robots.txt file:

User-agent: Googlebot
Disallow: /

flood6

6:14 pm on Jul 2, 2004 (gmt 0)

10+ Year Member

More about it here:

[searchengineworld.com...]