I found two posts about this, but still don;t know if they're to be blocked or not?
What's the impact of them selling the data?
Thanks
incrediBILL
6:55 pm on Feb 1, 2010 (gmt 0)
You want all your SEO work and list of outbound links available for sale?
I block it because I worked to make the site, I don't give away my secrets easily.
I also specify NOCACHE so you can't snoop my pages in SE cache and there's no copy to look at in the Internet Archive either.
smallcompany
7:55 pm on Feb 1, 2010 (gmt 0)
Does it obey robots.txt? I'll put it in and see how it goes.
Thanks
topr8
8:32 am on Apr 20, 2010 (gmt 0)
We plan on doing this in a manner that will cover our costs (selling our index) and releasing it for free for the benefit of all webmasters.
(from the Dotbot help page)
how can you sell it and release it for free .... smells fishy to me!
anyway i'm with incrediBILL, why should i let someone else extract all my data and sell it ... there's no benefit for me.
jmccormac
8:58 am on Apr 20, 2010 (gmt 0)
Blocked here at 403 level. With a rather large website with hundreds of millions of pages, leaving these characters loose on it is not an option. Also it appears to use multiple IPs for its hostnames.
Regards...jmcc
tangor
9:09 am on Apr 20, 2010 (gmt 0)
So far the bot has honored my robots.txt, and I'm pretty much on the look for bad bots. :)
No worries at the moment...
blend27
12:55 pm on Apr 20, 2010 (gmt 0)
Clover leaf for them on my sites. The Bot is Still guessing whether it's Four O' Three.. <-- see, only 2 dots~ Dot Nada.