how to programme a spider

[catfree]

Our company is trying to develop a spider-like search engine, of course much more limited.

Do you know where we can find technical information?

We are thinking to programme it with java and mysql, do you think this is the best solution?

Thanks in advance for your help

[DaveAtIFG]

A related discussion is at [webmasterworld.com...]