Where can I optain Spider List?

[clienttell]

Whare can I obtain a list of Search Engine Spiders in text format that is updated on a regular basis?

Thanks in advance

[skirril]

To my knowledge, not all spiders are in lists, some of them
don't even identify themselves.

[info.webcrawler.com...]

may be a good start.

Some spiders started coming with an info url in their UA field, eg. FAST

[cirelle]

have you tried

[searchengineworld.com...]

c

[JuniorHarris]

Are there any more current lists? That one list still has infoseek?!?

[skirril]

That is the only list I know. BTW: Infoseek.de still exists, and is well, so do other 'regional' Infoseeks probably

[JuniorHarris]

Thanks skirril, I started out with both those lists, but was hoping to find something more current. I guess I already have that in my spider table.?!?

Interesting about Infoseek, I didn't realize there were 'parts' still working.

[paynt]

This is probably too much for a reply so if you need to remove it feel free. This is my Google and Inktomi spider list.... If anyone sees an IP that doesn't fit,please let me know.

63.83.186.60-70¦google
64.208.33.33¦google
64.208.33.34¦google
64.208.36.2¦Google
64.208.36.28¦Google
64.208.36.30¦Google
64.208.36.35¦Google
64.208.36.39¦Google
64.208.36.42¦Google
64.208.36.47¦Google
64.208.36.48¦Google
64.208.36.49¦Google
64.208.36.53¦Google
64.208.36.55¦Google
64.208.36.56¦Google
64.208.36.57¦Google
64.208.36.58¦Google
64.208.36.60¦Google
64.208.36.63¦Google
64.208.36.69¦Google
64.208.36.7¦Google
64.208.36.77¦Google
64.208.36.79¦Google
64.208.36.8¦Google
64.208.37.10¦Google
64.208.37.11¦Google
64.208.37.15¦Google
64.208.37.17¦Google
64.208.37.2¦Google
64.208.37.23¦Google
64.208.37.26¦Google
64.208.37.27¦Google
64.208.37.28¦Google
64.208.37.3¦Google
64.208.37.30¦Google
64.208.37.32¦Google
64.208.37.33¦Google
64.208.37.34¦Google
64.208.37.35¦google
64.208.37.39¦Google
64.208.37.4¦Google
64.208.37.41¦Google
64.208.37.42¦Google
64.208.37.44¦Google
64.208.37.45¦Google
64.208.37.47¦Google
64.209.181.48¦google
64.209.181.49¦google
64.209.181.50¦google
64.209.181.51¦google
64.209.181.52¦google
64.209.181.53¦google
64.209.181.54¦google
64.209.181.55¦google
207.88.29.130¦google
209.185.108.130¦google
209.185.108.131¦google
209.185.108.132¦google
209.185.108.133¦google
209.185.108.134¦google
209.185.108.135¦google
209.185.108.136¦google
209.185.108.137¦google
209.185.108.138¦google
209.185.108.139¦google
209.185.108.140¦google
209.185.108.141¦google
209.185.108.142¦google
209.185.108.143¦google
209.185.108.144¦google
209.185.108.145¦google
209.185.108.146¦google
209.185.108.147¦google
209.185.108.148¦google
209.185.108.149¦google
209.185.108.150¦google
209.185.108.151¦google
209.185.108.152¦google
209.185.108.153¦google
209.185.108.154¦google
209.185.108.155¦google
209.185.108.156¦google
209.185.108.157¦google
209.185.108.158¦google
209.185.108.159¦google
209.185.108.160¦google
209.185.108.161¦google
209.185.108.162¦google
209.185.108.163¦google
209.185.108.164¦google
209.185.108.165¦google
209.185.108.166¦google
209.185.108.167¦google
209.185.108.168¦google
209.185.108.169¦google
209.185.108.170¦google
209.185.108.171¦google
209.185.108.172¦google
209.185.108.173¦google
209.185.108.174¦google
209.185.108.175¦google
209.185.108.176¦google
209.185.108.177¦google
209.185.108.178¦google
209.185.108.179¦google
209.185.108.180¦google
209.185.108.181¦google
209.185.108.182¦google
209.185.108.183¦google
209.185.108.184¦google
209.185.108.185¦google
209.185.108.186¦google
209.185.108.187¦google
209.185.108.188¦google
209.185.108.189¦google
209.185.108.190¦google
209.185.108.191¦google
209.185.108.192¦google
209.185.108.193¦google
209.185.108.194¦google
209.185.108.195¦google
209.185.108.196¦google
209.185.108.197¦google
209.185.108.198¦google
209.185.108.199¦google
209.185.108.200¦google
209.185.253.¦google
209.185.253.166¦google
209.185.253.167¦google
209.185.253.168¦google
209.185.253.169¦google
209.185.253.170¦google
209.185.253.171¦google
209.185.253.172¦google
209.185.253.173¦google
209.185.253.174¦google
209.185.253.175¦google
209.185.253.176¦google
209.185.253.177¦google
209.185.253.178¦google
209.185.253.179¦google
209.185.253.180¦google
209.185.253.181¦google
209.185.253.182¦google
209.185.253.183¦google
209.185.253.184¦google
209.185.253.185¦google
209.185.253.186¦google
209.185.253.187¦google
209.185.253.188¦google

62.252.160.5¦inktomi
202.212.5.30¦inktomi
202.212.5.36¦inktomi
209.1.12.68¦Inktomi
209.1.13.231¦Inktomi
209.1.13.232¦Inktomi
209.1.38.1-255¦inktomi
209.67.206.126¦Inktomi
209.67.206.127¦Inktomi
209.67.206.133¦Inktomi
209.131.47.¦inktomi
209.131.48.¦inktomi
209.131.48.78¦Inktomi
209.131.48.100¦Inktomi
209.131.48.101¦Inktomi
209.131.48.140¦Inktomi
209.131.49.¦inktomi
209.185.122.111¦Inktomi
209.185.122.201¦Inktomi
209.185.122.202¦Inktomi
209.185.122.203¦Inktomi
209.185.122.204¦Inktomi
209.185.141.185¦Inktomi
209.185.141.200¦inktomi
209.185.141.209¦Inktomi
209.185.141.211¦Inktomi
209.185.141.226¦Inktomi
209.185.141.236¦Inktomi
209.185.143.42¦Inktomi
209.185.143.43¦Inktomi
209.185.143.58¦Inktomi
209.185.143.80¦inktomi
209.185.143.81¦inktomi
209.185.143.82¦inktomi
209.185.143.83¦inktomi
209.185.143.84¦inktomi
209.185.143.85¦inktomi
209.185.143.86¦inktomi
209.185.143.87¦inktomi
209.185.143.88¦inktomi
209.185.143.89¦inktomi
209.185.143.90¦inktomi
209.185.143.91¦inktomi
209.185.143.92¦inktomi
209.185.143.93¦inktomi
209.185.143.94¦inktomi
209.185.143.95¦inktomi
209.185.143.96¦inktomi
209.185.143.97¦inktomi
209.185.143.98¦inktomi
209.185.143.138¦Inktomi
209.185.143.183¦Inktomi
209.185.143.196¦Inktomi
209.185.143.201¦Inktomi
216.32.237.7¦inktomi
216.32.237.8¦inktomi
216.32.237.9¦inktomi
216.32.237.10¦inktomi
216.32.237.11¦inktomi
216.32.237.12¦inktomi
216.32.237.13¦inktomi
216.32.237.14¦inktomi
216.32.237.15¦inktomi
216.32.237.16¦inktomi
216.32.237.17¦inktomi
216.32.237.18¦inktomi
216.32.237.19¦inktomi
216.32.237.20¦inktomi
216.32.237.21¦inktomi
216.32.237.22¦inktomi
216.32.237.23¦inktomi
216.32.237.24¦inktomi
216.32.237.25¦inktomi
216.32.237.26¦inktomi
216.32.237.27¦inktomi
216.32.237.28¦inktomi
216.32.237.29¦inktomi
216.35.103.41¦Inktomi
216.35.103.42¦Inktomi
216.35.103.43¦Inktomi
216.35.103.44¦Inktomi
216.35.103.45¦Inktomi
216.35.103.46¦Inktomi
216.35.103.47¦Inktomi
216.35.103.48¦Inktomi
216.35.103.49¦Inktomi
216.35.103.50¦Inktomi
216.35.103.51¦Inktomi
216.35.103.52¦Inktomi
216.35.103.53¦Inktomi
216.35.103.54¦Inktomi
216.35.103.55¦Inktomi
216.35.103.56¦Inktomi
216.35.103.57¦Inktomi
216.35.103.58¦Inktomi
216.35.103.59¦Inktomi
216.35.103.60¦Inktomi
216.35.103.61¦Inktomi
216.35.103.62¦Inktomi
216.35.103.63¦Inktomi
216.35.103.64¦Inktomi
216.35.103.65¦Inktomi
216.35.103.66¦Inktomi
216.35.103.67¦Inktomi
216.35.103.68¦Inktomi
216.35.103.69¦Inktomi
216.35.103.70¦Inktomi
216.35.103.71¦Inktomi
216.35.103.72¦Inktomi
216.35.103.73¦Inktomi
216.35.103.74¦Inktomi
216.35.103.75¦Inktomi
216.35.103.76¦Inktomi
216.35.103.77¦Inktomi
216.35.103.78¦Inktomi
216.35.103.79¦Inktomi
216.35.103.80¦Inktomi
216.35.103.81¦Inktomi
216.35.116.41¦Inktomi
216.35.116.42¦Inktomi
216.35.116.43¦Inktomi
216.35.116.44¦Inktomi
216.35.116.45¦Inktomi
216.35.116.46¦Inktomi
216.35.116.47¦Inktomi
216.35.116.48¦Inktomi
216.35.116.49¦Inktomi
216.35.116.50¦Inktomi
216.35.116.51¦Inktomi
216.35.116.52¦Inktomi
216.35.116.53¦Inktomi
216.35.116.54¦Inktomi
216.35.116.55¦Inktomi
216.35.116.56¦Inktomi
216.35.116.57¦Inktomi
216.35.116.58¦Inktomi
216.35.116.59¦Inktomi
216.35.116.60¦Inktomi
216.35.116.61¦Inktomi
216.35.116.62¦Inktomi
216.35.116.63¦Inktomi
216.35.116.64¦Inktomi
216.35.116.65¦Inktomi
216.35.116.66¦Inktomi
216.35.116.67¦Inktomi
216.35.116.68¦Inktomi
216.35.116.69¦Inktomi
216.35.116.70¦Inktomi
216.35.116.71¦Inktomi
216.35.116.72¦Inktomi
216.35.116.73¦Inktomi
216.35.116.74¦Inktomi
216.35.116.75¦Inktomi
216.35.116.76¦Inktomi
216.35.116.77¦Inktomi
216.35.116.78¦Inktomi
216.35.116.79¦Inktomi
216.35.116.82¦Inktomi
216.35.116.83¦Inktomi
216.35.116.84¦Inktomi
216.35.116.85¦Inktomi
216.35.116.88¦Inktomi
216.35.116.90¦Inktomi
216.35.116.91¦Inktomi
216.35.116.92¦Inktomi
216.35.116.93¦Inktomi
216.35.116.94¦Inktomi
216.35.116.95¦Inktomi
216.35.116.96¦Inktomi
216.35.116.97¦Inktomi
216.35.116.99¦Inktomi
216.35.116.100¦inktomi
216.35.116.101¦Inktomi
216.35.116.102¦Inktomi
216.35.116.103¦Inktomi
216.35.116.104¦Inktomi
216.35.116.105¦Inktomi
216.35.116.106¦Inktomi
216.35.116.107¦Inktomi
216.35.116.108¦Inktomi
216.35.116.109¦Inktomi
216.35.116.110¦Inktomi
216.35.116.111¦Inktomi
216.35.116.112¦Inktomi
216.35.118.231¦Inktomi
216.35.119.253¦Inktomi
216.35.119.254¦Inktomi
216.35.119.48¦Inktomi
216.35.119.80¦Inktomi

[stn24]

paynt,

If I were you, I would take another look at this range: 63.83.186.60-70¦google. I would change it to 63.83.186.64-71. :)

[paynt]

Thanks for the tip stn24. I've been trying to get these spider lists in some kind of order for some time now.