Robots.txt

Banning googlebot

[Crush]

Is that enough to ban googlebot? How do I ban fast?

User-agent:Googlebot*
Disallow: /

[ukgimp]

What you have in the robots file is a polite request that search engines obey what you say. If you want to ban them you will need to do that on the server using htaccess.

If you wish not to be found by the likes of fast and others you will need to build up your polite request list.

So yes you need add more to your robots.

I thinnk you can disallow all agents but you may need to look that up.

Cheers

[Sinner_G]

AFAIK, you don't need the * after User-agent:Googlebot. But I'm not sure it will make a difference if you leave it there.

Regarding FAST:

User-agent: fast
Disallow: /

[Crush]

thanks guys!