Forum Moderators: open
69.31.4.167 - - [07/Dec/2004:14:59:08 -0800] "GET /robots.txt HTTP/1.0" 200 1705 "-" "maxomobot/dev-20041201 (maxomo; [67.102.134.34:4047...] ; maxomobot'at'maxomo.com)"
They say: "What, you ask, is this MAXOMO? It's a Video Search Engine that will launch shortly . We're working to become a major resource for users searching for video on the net."
Since I have no video for them to dine upon and they do mention respecting robots.txt...so they be banned.
I've chosen to deny the backbone range as well.
It doesn't appear to me as if they offer retail internet services. As a result (at least from my point of view) they fall into the colocation category.
Don
A ARIN on William Lu (Thread pending)
Will provide some insight and additional
Nlayer ip ranges as well.
Suggest Nlayer at ARIN as well.
Since I banned via robots.txt MAXOMObot has checked it each of three times and left, post haste.
As for another Nutch. <heavy sigh> I don't think we are any where near seeing saturation levels yet and that's what has me concerned.
I'd be interested to see what the relationship between spiders/bots and webmasters in ten years, or so. ;)