Forum Moderators: goodroi
I'd like to block it from taking ads from my classifieds site.
"We do our best to act as a responsible search engine. We strictly follow the robots.txt protocol and check it every time we visit a site. For those sites that don’t want to be included, they simply need to add a single line of text to their robots.txt file..."
(The writer goes on to talk about Craigslist.)
TOS prevents my linking the reference (to a blog), but when you Google --
oodle robot
-- you'll see it at the top of the list.
The Oodle writer's comments notwithstanding, it would be handy to know their bot's (or bots') ID and/or IP(s) and if any require specific notations beyond the basics.
But their site's robots.txt [oodle.com] is pretty basic so you can always start with --
User-agent: *
Disallow: /
