UbiCrawler/v0.3beta

to ban or not to ban?

[coyote]

UbiCrawler/v0.3beta (http://ubi.imc.pi.cnr.it/projects/ubicrawler/) from IP 146.48.97.14.

Anyone else seen this one? I read some of the info pages and still am not quite sure if I should ban it. On one hand, everyone has to start somewhere and once upon a time Google was just an experimental research crawler. On the other hand, there doesn't seem to be any clear-cut plans for this crawler past the current stage, as in any plans to become an SE spider. So why should I let it use my bandwidth?

[pendanticist]

Been mentioned before:
[webmasterworld.com...]

This sort of describes the 'intent' of the project.

http*//www.ics.mq.edu.au/acac/seminars/Abs030702.html

Hope this helps.

Pendanticist.

[coyote]

Thanks for the link. I'm going to ban this one because I don't think "snapshots" (sounds like G's cache) and collecting sites' info are important enough to warrant building a crawler like that, especially when there's no privacy policy or a policy on how the info may be distributed in the future.