This applies to other engines but Lycos is a good example.
We have a multi-lingual site (.com) in 5 European languages. If we target Lycos once - paid or unpaid will it spider the Italian pages so that they are available within lycos.it or do we need to target each engine separately. As with all marketing activities effort is required however, there is not point targeting each country engine if the pan-europe one does it? Any views welcome.
Lycos doesn't spider for their websearch results - they currently use ATW. ATW is in a period of transition, but at this point they offer PFI as well as free spidering. If you pay you would have to pay for each single page you want them to spider, thus you'd have to pay for say your index page for each language seperately.
In general we only have two important global free spidering engines at this point: Google, and Inktomi.
Inktomi works as described for ATW, but for both, INK and ATW, I would at this point not recommend to pay.
Inktomi, ATW, Altavist, Google -they all will find your pages, all of them, if you have good links pointing to the site and to the pages in seperate languages. When they have spidered them they will in 99,9% of all cases automatically recognize your language and show them in appropriately.