ScoutJet is me, it is a good robot. It has a 45-second min delay between fetches per-ipaddr. Of course you are free not to let it in, it obeys robots.txt of course.
incrediBILL, totally agree on the poor value from niche search engines. Not our intent. Full scale real web search is so much more interesting.
Was never endorsed or proposed by any standards body. New engines are not obligated to honor another search engines proprietary commands.
Before you run over a cliff with wild bs, you really should checkout Blekko, it has some awesome features. You plugged your nose when Google came around with all it's own issues (like 'caching') - give Blekko the same chance.
There will be updates and changes to their engine as they progress. No engine is going to be without mistakes or oversights when they first get going.
Rich [webmasterworld.com] is a very old friend of this community and long time user of WebmasterWorld.