Is Googlebot not a "niceguy" spider

Robots.txt example seems to say No!

[awoyo]

I was looking at the examples of the robots.txt here on WebmasterWorld and found that googlebot is excluded in robots4.txt [searchengineworld.com] Is that right? How come?

User-agent: Googlebot
Disallow:

[mbauser2]

You don't know how to read robots.txt. That entry doesn't block Google from anything.

[Key_Master]

To block Googlebot from indexing any portion of your site your robots.txt should look like:

User-agent: Googlebot
Disallow: /

or

User-agent: *
Disallow: /

There is loads of information about robots.txt on this site. By the way, robots4.txt (the filename) is useless. No robot is going to abide by that.

[jdMorgan]

Awoyo,

User-agent: Googlebot
Disallow: /

blocks Googlebot from all files, and

User-agent: Googlebot
Disallow:

welcomes Googlebot to index all files.

For more information about robots.txt, see this page [searchengineworld.com] on WebmasterWorld's sister site.
(Note that one example is incorrect - "cheese.html" needs a preceding "/")

Googlebot is NOT a bad-bot!

Hope this helps,
Jim

[GoogleGuy]

Beat me to it. Thanks for chiming in, folks.

[awoyo]

Thanks for clearing that up, folks. I guess seeing googlebot treated the same as Emailsiphon, WebFerret and BlackWidow got me going for a minute. :)

[Markus]

> Googlebot is NOT a bad-bot!

But why does Google index my WebmasterWorld profile for at least two months now, although there is a meta robots noindex on it? ;)

[jdMorgan]

Markus,

awoyo got confused between the two forms I show in my post above.

Googlebot is NOT disallowed from WebmasterWorld, AFAIK.

Jim