robots.txt - Sitemaps, Meta Data, and robots.txt forum at WebmasterWorld - WebmasterWorld

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt

Just checking

hurlimann

6:10 pm on Aug 18, 2002 (gmt 0)

10+ Year Member

Is this correct:

User-agent: Googlebot
Disallow: /

We want to disallow google but allow everything else.

SebastianX

6:59 pm on Aug 18, 2002 (gmt 0)

10+ Year Member

Yes, or

User-agent: googlebot
Disallow: /

both works for me