Crawler

I'm looking for an open source crawler ...

[doc_z]

I'm looking for an open source web crawler. Does anybody know a good one?

Non-Java solutions are highly preferred.

[bcolflesh]

[nutch.org...]

[Easy_Coder]

based on the tutorial page this appears to be a java based solution.

[bcolflesh]

If Nutch doesn't suit, Grub is available:

[sourceforge.net...]

C++ based

<edit>
Another C++ one is larbin:

[sourceforge.net...]
</edit>

[doc_z]

Thanks, I'll try Grub and larbin because nutch is Java based but my C knowledge is better.