Spider databases?

Downloadable databases with spider info?

[aetjansen]

Hi All,

I know there are a lot of posts with requests for lists of IP's and stuff on spiders, but I am trying to make an ASP cloak script (purely educational) and I would like to use an MSAccess database. Is there a place where I could download a fairly up-to-date database or CSV file or anything?

I have a list from spiderhunter.com but it contains "only" 334 entries, while I read on some other site they had a list with 880 identified spiders for Inktomi alone?!

Thanks,
Best,
Arno

[Will]

There are several sites with lists of IPs that make even 880 look paltry!

I think external links are somewhat unwelcome in these forums, so drop me a mail and I'll give you a few useful sites for both IP lists and ASP scripts of this type.

Hope this helps.

[caine]

aetjansen,

have a look at Brett's Collection of spider names / ip's @ [serachengineworld.com...]

[Canton]

Hello all,

I've read these posts with interest as I'm just exploring cloaking as well. I'm looking for a good place to start for a list of spider IPs and wondered what the definitive list is? Would you consider Brett's spider IP list to be the most complete, or is there another that anyone is aware of that is more complete?

Also, what resources are there for keeping up-to-date lists of IPs? Some are paid I'm sure and that's fine, and if there are any free resources, all the better. Any help is appreciated.

~Canton