Forum Moderators: open
As far as I know, you only have to use Googlebot. Now if the pages you put in your robots.txt are already indexed by Google, it may take a few months for Google to take them out.
User-agent: Googlebot
Disallow: /cgi-bin
Disallow: /images
Disallow: /doh.htm
This should keep Googlebot away from those parts of your site. If you want to keep all bots away from the same parts of your site, you can do this instead:
User-agent: *
Disallow: /cgi-bin
Disallow: /images
Disallow: /doh.htm
Here are some helpful links:
[info.webcrawler.com...]
[info.webcrawler.com...]
[webmasterworld.com...]