Up to date search engine spider IP lists.

anyone?

[caine]

I need to get my hands on an upto date and almost comprehensive Spider IP list for the crawlers, i come accross an excellant post, via site search from Xoc < below

[webmasterworld.com...]

which i have blocked together as good as i could. However the list is from early last year, though not fearing that anything is wrong, more that its not current with the growths and declines of SE's.

[Dreamquick]

i seem to remember a while ago that volatilegx was involved in such a thing and indeed in his profile you'll find a link to;

iplists.com

which claims to have very recent results and at the time this all came up because someone recomended the site so I guess some people clearly like his data. Although having never used it myself (although I may have plans to pretty soon) I couldn't comment on its accuracy or quality.

- tony

[volatilegx]

Hi guys...

Yep I have a site that lists IP addresses of SE spiders. (see profile)

No guarantees as to accuracy, completeness, etc. but I do my best.

[pageoneresults]

How about this one...

Database of Web Robots [robotstxt.org]