SpiderTrap Caught these IPs

Some are proxies, am I losing traffic?

[prozz]

Hi Guys,
I setup a spiderTrap on my site, as soon as spider follows the link they go to my deny list and get blocked (with exclusion of goo 6-7 bots, ie googlebot etc)

Do you guys think it's a good idea to use SpiderTraps? is it possible i'll block some IP which might be used by many people? How big is the risk?

These are the bots that I caught so far.

0-1pool127-85.nas11.fort-lauderdale1.fl.us.da.qwest.net
116-154-239-64.pajo.com
12-225-125-208.client.attbi.com
12-245-39-36.client.attbi.com
12-246-0-108.client.attbi.com
139.141.102.102
148.246.160.191
152.134.252.64.snet.net
154.184.33.65.cfl.rr.com
158.108.107.7
159.134.206.184
166.114.165.227
166.114.80.200
192.239.92.233
193.35.125.9
194.6.2.151
195.14.236.29
195.141.85.146
195.226.55.252
195.36.121.26
195.5.44.110
195.66.45.228
195.8.3.187
19dyn6.com21.casema.net
1Cust117.tnt1.waipahu.hi.da.uu.net
1Cust160.tnt1.sagamihara.jp.fj.da.uu.net
1Cust17.tnt3.richmond.va.da.uu.net
1Cust43.tnt4.daytona-beach.fl.da.uu.net
200-161-148-57.dsl.telesp.net.br
200.162.208.150.sao.ajato.com.br
200.181.49.194
200.190.24.17
200.193.211.19
200.37.81.101
205.184.252.3
205.208.203.54
205.215.58.21
205.215.58.22
206.211.166.17
206.252.147.36
207.219.43.34
207.31.249.201
207.31.249.202
207.31.249.203
207.31.249.204
207.31.249.208
207.31.249.210
207.31.251.141
207.31.251.142
207.31.251.146
207.31.251.147
207.31.251.150
208-189-31-101.powerflame.com
208.179.60.2
208.191.87.35
208.217.241.11
208.23.188.12
208.247.37.31
209-122-237-46.s554.apx1.nyw.ny.dialup.rcn.com
212.113.82.197
212.137.49.26
213-97-245-73.uc.nombres.ttd.es
213.189.83.102
213.217.48.111
213.78.64.186
216-210-225-218.atgi.net
216.191.23.195
216.20.10.39
216.234.218.232.gilanet.com
216.241.35.58
216.25.132.239
216.76.84.226
217-125-190-85.uc.nombres.ttd.es
217.98.112.122
24-205-54-204.glen-dyn.charterpipeline.net
24.219.24.79
24.222.3.250
24.222.74.131
40-156.farcpe.cableone.net
62.114.92.140
62.211.193.239
63.115.132.3
63.121.196.210
64-212-176-14.roc.frontiernet.net
64-42-105-200.atgi.net
64.238.100.35
64.246.0.17
64.45.170.58.cypresscom.net
64.88.4.2
64.95.130.46
65.163.34.252
65.203.20.50
65.211.112.204
653264hfc139.tampabay.rr.com
66-108-206-247.nyc.rr.com
66-42-117-230.lsan.dial.netzero.com
66.147.154.3
66.82.36.255
67.34.131.105
80-25-253-151.uc.nombres.ttd.es
80.225.85.73
80.247.136.119
99-154-239-64.pajo.com
A-MOHAMED.phys.tue.nl
A010-0013.OTMW.splitrock.net
A010-0742.MLE2.splitrock.net
AC82F194.ipt.aol.com
AC8B221C.ipt.aol.com
AC968295.ipt.aol.com
ACA6D43B.ipt.aol.com
ACA87591.ipt.aol.com
ACAB43B3.ipt.aol.com
ACAF9636.ipt.aol.com
ACB30A05.ipt.aol.com
ACB8297F.ipt.aol.com
ACC00198.ipt.aol.com
ACC3B532.ipt.aol.com
CPE0050180314e5.cpe.net.cable.rogers.com
HSE-Kingston-ppp328909.sympatico.ca
HSE-Kingston-ppp329649.sympatico.ca
OL156-153.fibertel.com.ar
OL24-71.fibertel.com.ar
R57-121.seed.net.tw
W0023051.mgh.harvard.edu
WCS2-MOFFETT.NIPR.MIL
YahooBB238138010.bbtec.net
YahooBB238166071.bbtec.net
YahooBB239238021.bbtec.net
a200042087094.rev.prima.com.ar
a55-139.dialup.iol.cz
acq02.xyleme.com
acq03.xyleme.com
acq04.xyleme.com
acq06.xyleme.com
acq07.xyleme.com
acq08.xyleme.com
adriatic.terra.net.lb
adsl-144-4.wanadoo.be
adsl-208-201-244-128.sonic.net
adsl-216-101-234-35.dsl.snfc21.pacbell.net
adsl-34-29-242.mia.bellsouth.net
adsl-65-70-142-161.dsl.kscymo.swbell.net
adsl-66-126-126-219.dsl.lsan03.pacbell.net
adsl-66-126-126-220.dsl.lsan03.pacbell.net
adsl-67-38-64-243.dsl.sfldmi.ameritech.net
alfredo.wise-guys.nl
bgp511684bgs.verona01.nj.comcast.net
biozak.innetix.com
bwcache1zhh.bluewin.ch
c-24-126-133-248.we.mediaone.net
c-24-126-134-0.we.mediaone.net
c-24-126-134-5.we.mediaone.net
c17s40h4.upc.chello.no
ca-crlsbd-u2-c5a-194.crlsca.adelphia.net
cacheflow2.umbc.edu
cfw.candw.lc
client-141-151-130-123.ba-dsg.net
cm086.67.234.24.lvcm.com
cm120.28.234.24.lvcm.com
cpe-66-1-38-217.az.sprintbbd.net
customer-200-33-151-252.uninet.net.mx
d56.as21.nwbl0.wi.voyager.net
dfw-28-a-93.dfw.dsl.cerfnet.com
diana.iol.it
dsl-64-34-101-5.telocity.com
dsl254-054-168.sea1.dsl.speakeasy.net
dyn-212-129-38-77.ppp.libertysurf.fr
encke.iol.it
eu99-88-10.clientes.euskaltel.es
evrtwa1-ar7-4-61-039-243.evrtwa1.vz.dsl.gtei.net
gso57-104-093.triad.rr.com
gw.movistar.net
h-207-148-132-148.dial.cadvision.com
h-66-134-164-100.LSANCA54.covad.net
h-66-134-164-102.LSANCA54.covad.net
h00b0d062ac4e.ne.mediaone.net
h213-10-245.BO1.albacom.net
host-64-161-220-24.midco.net
host-d15372ff.nmcco.com
host093138.arnet.net.ar
host100251.arnet.net.ar
host213-1-187-191.btinternet.com
host213-123-1-91.onmail.co.uk
host213-123-115-26.in-addr.btopenworld.com
host213-123-13-87.btinternet.com
host217-35-93-50.in-addr.btopenworld.com
host217-37-196-141.in-addr.btopenworld.com
hvc-66-67-32-141.hvc.rr.com
ip100-243.the-beach.net
ip503c33cd.speed.planet.nl
ip68-1-223-2.dl.dl.cox.net
ip68-12-41-76.ok.ok.cox.net
ip68-6-166-231.sd.sd.cox.net
islandtelecom254-137.islandtelecom.com
kenter.fh-bielefeld.de
maeva.inist.fr
mail.innovum.de
mail.jwhcorp.com
mail.mcvuk.com
modemcable014.69-201-24.mtl.mc.videotron.ca
modemcable244.57-202-24.mtl.mc.videotron.ca
mp-216-42-39.daxnet.no
mx.akonta.tula.net
nat.infospace.com
netcache-1112.public.svc.webtv.net
netcache-1115.public.svc.webtv.net
netser-colo-01.whoc.theplanet.co.uk
ng1.exabot.com
p5082108A.dip.t-dialin.net
pD901396A.dip.t-dialin.net
pD9516422.dip.t-dialin.net
pD9E11308.dip.t-dialin.net
pD9E6D6C6.dip.t-dialin.net
palo15.pacific.net.sg
pcp01229219pcs.roylok01.mi.comcast.net
pcp01319180pcs.toresd01.pa.comcast.net
pcp01416913pcs.umrion01.pa.comcast.net
pcp171332pcs.plsntv01.nj.comcast.net
pcp803777pcs.nrockv01.md.comcast.net
pec-32-7.tnt5.me2.uunet.de
pool-138-88-47-67.res.east.verizon.net
pool-151-197-214-74.phil.east.verizon.net
port30.cvx1-sto.ppp.netlink.se
pr8-ts.telepac.pt
proxy.rete039.it
proxy2.pinellas.k12.fl.us
right.thunderstone.com
sc-66-27-11-57.socal.rr.com
signup.sonnet.co.uk
spider12.ewatch.com
spider13.ewatch.com
spider20.tiscalinet.it
spider7.ewatch.com
sync03.avantgo.com
sync04.avantgo.com
sync07.avantgo.com
sync08.avantgo.com
sync11.avantgo.com
sync18.avantgo.com
sync19.avantgo.com
sync20.avantgo.com
sync26.avantgo.com
sync34.avantgo.com
trt-on66-091.netcom.ca
user-1120tgp.dsl.mindspring.com
user-2ivficf.dialup.mindspring.com
vip.tvc.ntl.com
watcher.lan.onvoy.com
wks-65-27-15-140.kscable.com
wwwproxy.BelWue.DE
zeus.unicefusa.org

[Key_Master]

I'm using one. It's on a page that robots.txt clearly prohibits spidering.

To prevent an innocent user from clicking on the link I hide it in a 1x1 transparent image and use onclick="return false;" in the URL. Very effective and no innocent visitors banned to date.

[Tapolyai]

This sounds excellent!

Can you give a bit more detail?

So you have a line in your robots.txt to deny to the specific page,
then have a link to the page from your front page,
then you hide it,
then you add all IPs (or agents, or both?) to deny list?

I am completely useless when it comes to .htaccess files. How does this spider trap page looks like? I assume it rewrites the .htaccess...

[Key_Master]

I'll send you an example by sticky mail.

[Marcia]

You sure you're not blocking ISPs? I've never heard of any like Mindspring and Roadrunner having spiders. And I don't believe they dial up:

>209-122-237-46.s554.apx1.nyw.ny.dialup.rcn.com

[Key_Master]

>>>I've never heard of any like Mindspring and Roadrunner having spiders.

That may be true but the visitors might.

[amoore]

I would be cautious about permanently denying any IP addresses that you're not sure about. I wrote and run one of these spidertraps and have found about a billion ways that you can accidently ban innocent users or dialup addresses. I find that letting them back in after a time period frustrates the guilty ones enought to keep them out.

That said, they're pretty handy ways to keep obnoxious robots out of your site.

If you're interested in my mod_perl module that bans people for going in forbidden places, you can get it at [mooresystems.com...] or find a similar one in the mod_perl developer's cookbook.

[Marcia]

prozz, you've got a lot of ISPs banned there, a LOT of them.

[prozz]

well ya, a lot of isps.

The reason is that nowadays it is very popular to harvest for email addresses. People get dsl's cable's and write a spider to gather email addresses.

I am not really worried about having blocked some guy who was investigating my site for hidden links (who cares for that curious one..lol)

I'm more interested in finding out, weather or not there are major proxies out there,,,or IPs that let thousands of people surf the web through ONE IP address.

[bird]

Just remember that most addresses on this planet are either assigned dynamically, routed through a proxy, or both. This means that the majority of the visitors you're going to block will be completely innocent.

[Key_Master]

Unless the IP is a known static address, banning should be used to block an action by a malicious visitor. This means that some blocked IP's should be routinely removed from the list.

[littleman]

I Yeah, it is probably a good idea to unban IPs every so often. Instead of banning, I do a sort of reverse cloaking on rouge bots. I have a script that judges IPs as they come in and if it looks like something foul I'll take some steps to hide my goods from view.

[wilderness]

<snip>prozz, you've got a lot of ISPs banned there, a LOT of them>

Hey Marcia,
prozz only has a few :-(
Pray tell if you saw my htacess you would surely faint and go into convulsions from the shock of seeing some 350 lines of IP #'s in addition to limiting commands :-(

IMO the judgement is entirely dependent upon the content of the site and the market your serving.
If you were selling widgets and most every consumer had an interest in widgest than limited denies would make sense.
However if your site is concentrated around grits and oakra than you might consider blocking reigons or even continents.

In the same breath if there is a specific IP range which has repeatedly acted maliciously and both the back-bone provider and the immediate provider refuse to offer a amicable solution? Than OUR only alternative it to deny large blocks.

just my thoughts :-(

[rjohara]

A question about email scrapers in this context: if I have a lot of mailto: url's on my pages, is there any benefit to deactivating them but leaving the email address in place as text? (I.e., get rid of mailto:[e-mail] but leave [e-mail] as text for a human to read.) If email scrapers just read the page source looking for @'s I suppose this won't help.

[wilderness]

<snip>A question about email scrapers in this context>

Hey rjohara,
First, I hope you realize that use of the mailto: ONLY catches MS mails?
With that caution spoken?
Do like I say not like I do ;-)

Scripts are the proper precedure for forms.
However BE CAUTIONED should you use an off-the-shelf script?
You should make it seucre and ALLWAYS rename the script and the paths from their default.
There is an old DOS trick for file duplications that works just fine.

I have mailto: links on each of my webpages as related to my websites. Those particular emails are not my concern. We as extensive users of the net have easily adapted to spam in the application of mail filters.

However there are specific sections of sites which are concentrated with email addresses which are not related to the website property. My concerns are in protecting those listings from the grabbers. Those users are not as aware as I at filering out garbage.
In addition my main site has over 1200 categorized URL's. Much like a directory as they are related to specific section content. Some of these URL's took days and weeks to accumulate. It is beyond my reasonable ability in sharing treasures found with some bots. Most especially bots of commercial or ventures which are being compensated by clients to gather data from my non-profit sweat. Or even bots with no history or clearly defined use for what they gather.

That may be purely selfish on my part. However the content whether text, graphics, html, emails, or URL's are what make my sites unique.

Many SE's have entered into paid listings however they have yet to find a way to compensate sites for the data they benefit from, or the bandwidth they can errantly consume.

[Brett_Tabke]

Fascinating discussion.

How does your spider trap work prozz?

What I do is,
- a write hidden link to page.
- make sure link is banned by robots.txt
- link leads to trap script that generates 1.htm
- 1.htm is a simple file, with a hidden link that points back to trap script, and passes "1"
- trap script creates 2.htm with a link that points back...
- trap script continues to write x.htm pages until a preset limit.
- if spider makes it to the preset limit (say five to 10), they trigger the kill switch script
- kill switch script auto adds them to the .htaccess ban list for the site.

[prozz]

Brett_Tabke,

what we do is,

I put a link on my page. (<a href="trap.html">1px image</a>

as soon as the spider (or anybody else who found it, clicks on that link, our script automaticly gets their IP (php) and adds it to our deny.access list (we're using mod_rewrite for denying access (giving the banned IPs a blank page, i'm sure .htaccess can do the same)

the list is getting larger and larger..already 360 or so (will have to unban some IPs i guess:

0-1pool127-85.nas11.fort-lauderdale1.fl.us.da.qwest.net
08-202.032.popsite.net
116-154-239-64.pajo.com
12-225-125-208.client.attbi.com
12-225-162-144.client.attbi.com
12-239-161-185.client.attbi.com
12-245-39-36.client.attbi.com
12-246-0-108.client.attbi.com
139.141.102.102
148.246.160.191
152.134.252.64.snet.net
154.184.33.65.cfl.rr.com
158.108.107.7
159.134.206.184
166.114.165.227
166.114.80.200
192.239.92.233
193.35.125.9
194.224.26.189
194.6.2.151
194.6.2.152
194.muedb.lsan.la6ca01r1.dsl.att.net
195.103.246.129
195.14.236.29
195.141.85.146
195.226.55.252
195.36.121.26
195.5.44.110
195.66.45.228
195.8.3.187
19dyn6.com21.casema.net
1Cust117.tnt1.waipahu.hi.da.uu.net
1Cust160.tnt1.sagamihara.jp.fj.da.uu.net
1Cust17.tnt3.richmond.va.da.uu.net
1Cust43.tnt4.daytona-beach.fl.da.uu.net
200-158-6-246.dsl.telesp.net.br
200-161-148-57.dsl.telesp.net.br
200.162.208.150.sao.ajato.com.br
200.181.49.194
200.190.24.17
200.193.211.19
200.193.212.70
200.35.65.31
200.37.81.101
204.17.118.host42
205.184.252.3
205.208.203.54
205.215.58.21
205.215.58.22
206.211.166.17
206.252.147.36
207.219.43.34
207.236.197.206
207.31.249.201
207.31.249.202
207.31.249.203
207.31.249.204
207.31.249.208
207.31.249.210
207.31.251.141
207.31.251.142
207.31.251.143
207.31.251.146
207.31.251.147
207.31.251.148
207.31.251.150
208.179.60.2
208.189.31.101
208.191.87.35
208.217.241.11
208.227.137.124
208.23.188.12
208.247.37.31
209-122-237-46.s554.apx1.nyw.ny.dialup.rcn.com
212.113.82.197
212.137.49.26
212.199.73.58
213-96-40-135.uc.nombres.ttd.es
213-97-245-73.uc.nombres.ttd.es
213.11.100.8
213.189.83.102
213.217.48.111
213.78.64.186
216-210-225-218.atgi.net
216.191.23.195
216.20.10.39
216.234.218.232.gilanet.com
216.241.35.58
216.25.132.239
216.76.84.226
217-125-190-85.uc.nombres.ttd.es
217-127-54-35.uc.nombres.ttd.es
217.98.112.122
24-205-54-204.glen-dyn.charterpipeline.net
24.101.235.118
24.219.24.79
24.222.3.250
40-156.farcpe.cableone.net
402cust-12_154_4_203.gpcom.net.4.154.12.in-addr.arpa
62.114.92.140
62.176.117.76
62.211.193.239
63.108.93.4
63.115.132.3
63.121.196.210
64-212-176-14.roc.frontiernet.net
64-42-105-200.atgi.net
64-60-71-25-cust.telepacific.net
64.238.100.35
64.246.0.17
64.45.170.58.cypresscom.net
64.88.4.2
64.95.130.46
65.163.34.252
65.203.20.50
65.211.112.204
653264hfc139.tampabay.rr.com
66-108-206-247.nyc.rr.com
66-42-117-230.lsan.dial.netzero.com
66.147.154.3
66.82.36.255
67.34.131.105
80-25-253-151.uc.nombres.ttd.es
80.247.136.119
99-154-239-64.pajo.com
9lyon1-0-sv-cache-1.9tel.net
A-MOHAMED.phys.tue.nl
A010-0013.OTMW.splitrock.net
A010-0742.MLE2.splitrock.net
A050-0135.CHCG.splitrock.net
AC82F194.ipt.aol.com
AC8B221C.ipt.aol.com
AC9572B3.ipt.aol.com
AC968295.ipt.aol.com
ACA0CA12.ipt.aol.com
ACA6D43B.ipt.aol.com
ACA87591.ipt.aol.com
ACA8917B.ipt.aol.com
ACA8B278.ipt.aol.com
ACAB43B3.ipt.aol.com
ACAF9636.ipt.aol.com
ACB30A05.ipt.aol.com
ACB5EC8D.ipt.aol.com
ACB8297F.ipt.aol.com
ACC00198.ipt.aol.com
ACC3B532.ipt.aol.com
CPE0050180314e5.cpe.net.cable.rogers.com
HMMcc-02p18.ppp.odn.ad.jp
HSE-Kingston-ppp328909.sympatico.ca
HSE-Kingston-ppp329649.sympatico.ca
HSE-Ottawa-ppp3493589.sympatico.ca
MTL-HSE-ppp207384.qc.sympatico.ca
OL156-153.fibertel.com.ar
OL24-71.fibertel.com.ar
OL48-226.fibertel.com.ar
R57-121.seed.net.tw
W0023051.mgh.harvard.edu
WCS2-MOFFETT.NIPR.MIL
YahooBB224228051.bbtec.net
YahooBB237080012.bbtec.net
YahooBB238138010.bbtec.net
YahooBB238166071.bbtec.net
YahooBB239238021.bbtec.net
a200042087094.rev.prima.com.ar
a55-139.dialup.iol.cz
acq01.xyleme.com
acq02.xyleme.com
acq03.xyleme.com
acq04.xyleme.com
acq05.xyleme.com
acq06.xyleme.com
acq07.xyleme.com
acq08.xyleme.com
adriatic.terra.net.lb
adsl-144-4.wanadoo.be
adsl-208-201-244-128.sonic.net
adsl-216-101-234-35.dsl.snfc21.pacbell.net
adsl-33-164-17.asm.bellsouth.net
adsl-34-29-242.mia.bellsouth.net
adsl-63-207-239-137.dsl.chic01.pacbell.net
adsl-64-169-112-149.dsl.lsan03.pacbell.net
adsl-64-218-87-14.dsl.stlsmo.swbell.net
adsl-65-70-142-161.dsl.kscymo.swbell.net
adsl-66-126-126-219.dsl.lsan03.pacbell.net
adsl-66-126-126-220.dsl.lsan03.pacbell.net
adsl-66-126-126-221.dsl.lsan03.pacbell.net
adsl-67-36-184-139.dsl.chcgil.ameritech.net
adsl-67-38-64-243.dsl.sfldmi.ameritech.net
adsl-81-223-75.tys.bellsouth.net
akgz0way42ec.bc.hsia.telus.net
alfredo.wise-guys.nl
altavista.mtv3.fi
asd-tel-ap02-d09-163.dial.freesurf.nl
b30323ibb8jj.bc.hsia.telus.net
bgp01093663bgs.waren401.mi.comcast.net
bgp511684bgs.verona01.nj.comcast.net
biozak.innetix.com
bw2-165pub82.bluewin.ch
bwcache1zhh.bluewin.ch
c-24-126-133-248.we.mediaone.net
c-24-126-134-0.we.mediaone.net
c-24-126-134-5.we.mediaone.net
c17s40h4.upc.chello.no
ca-crlsbd-u2-c5a-194.crlsca.adelphia.net
cache-cro-hsi.cableinet.co.uk
cache-mtc-af06.proxy.aol.com
cache-rl03.proxy.aol.com
cache-wit-hsi.cableinet.co.uk
cacheflow2.umbc.edu
cdm-66-160-161-boss.cox-internet.com
cfw.candw.lc
client-141-151-130-123.ba-dsg.net
client62-2-72-8.hispeed.ch
cm086.67.234.24.lvcm.com
cm120.28.234.24.lvcm.com
cm171.116.120.24.lvcm.com
cm39-50.liwest.at
cpe-66-1-182-167.ut.sprintbbd.net
cpe-66-1-38-217.az.sprintbbd.net
customer-200-33-151-252.uninet.net.mx
d56.as21.nwbl0.wi.voyager.net
dfw-28-a-93.dfw.dsl.cerfnet.com
dialin-80202.ewetel.net
diana.iol.it
dnvrapanas21poolb171.dnvr.uswest.net
dsl-64-34-101-5.telocity.com
dsl254-054-168.sea1.dsl.speakeasy.net
dyn-212-129-38-77.ppp.libertysurf.fr
echobridgeinc.com
encke.iol.it
eu99-88-10.clientes.euskaltel.es
evrtwa1-ar7-4-61-039-243.evrtwa1.vz.dsl.gtei.net
gso57-104-093.triad.rr.com
h-207-148-132-148.dial.cadvision.com
h-66-134-164-100.LSANCA54.covad.net
h-66-134-164-102.LSANCA54.covad.net
h-66-134-164-99.LSANCA54.covad.net
h00b0d062ac4e.ne.mediaone.net
h109n2fls31o829.telia.com
h213-10-245.BO1.albacom.net
h24-78-203-102.vn.shawcable.net
hfx-01-209226115065.3web.net
hh1105069.direcpc.com
host-29-108.dsl-sea.seanet.com
host-64-161-220-24.midco.net
host-d15372ff.nmcco.com
host093138.arnet.net.ar
host100251.arnet.net.ar
host213-1-187-191.btinternet.com
host213-123-1-91.onmail.co.uk
host213-123-11-108.btinternet.com
host213-123-11-189.btinternet.com
host213-123-115-26.in-addr.btopenworld.com
host213-123-13-87.btinternet.com
host217-35-93-50.in-addr.btopenworld.com
host217-37-196-141.in-addr.btopenworld.com
hvc-66-67-32-141.hvc.rr.com
inet-netcache2-o.oracle.com
ip-202-20.theramp.net
ip100-243.the-beach.net
ip503c33cd.speed.planet.nl
ip64.usw1.rb1.pdx.nwlink.com
ip68-1-223-2.dl.dl.cox.net
ip68-12-41-76.ok.ok.cox.net
ip68-13-169-64.om.om.cox.net
ip68-6-166-231.sd.sd.cox.net
islandtelecom254-137.islandtelecom.com
k114-124.kingsley.co.za
kenter.fh-bielefeld.de
maeva.inist.fr
mail.innovum.de
mail.jwhcorp.com
mail.mcvuk.com
might.thunderstone.com
modemcable014.69-201-24.mtl.mc.videotron.ca
modemcable244.57-202-24.mtl.mc.videotron.ca
mp-216-42-39.daxnet.no
mx.akonta.tula.net
nat.infospace.com
nc5.emirates.net.ae
ncache01.terra.cl
netcache-1112.public.svc.webtv.net
netcache-1113.public.svc.webtv.net
netcache-1115.public.svc.webtv.net
netser-colo-01.whoc.theplanet.co.uk
ng1.exabot.com
ool-182d8f31.dyn.optonline.net
oper8.teleross.ru
p5082108A.dip.t-dialin.net
p50862C42.dip.t-dialin.net
pD4B9E317.dip.t-dialin.net
pD901396A.dip.t-dialin.net
pD9516422.dip.t-dialin.net
pD9E11308.dip.t-dialin.net
pD9E6D6C6.dip.t-dialin.net
pD9E6DC5C.dip.t-dialin.net
palo15.pacific.net.sg
pcp01229219pcs.roylok01.mi.comcast.net
pcp01319180pcs.toresd01.pa.comcast.net
pcp01416913pcs.umrion01.pa.comcast.net
pcp171332pcs.plsntv01.nj.comcast.net
pcp803777pcs.nrockv01.md.comcast.net
pec-32-7.tnt5.me2.uunet.de
ph249.gdansk.cvx.ppp.tpnet.pl
pool-138-88-47-67.res.east.verizon.net
pool-141-158-12-215.phil.east.verizon.net
pool-151-197-214-74.phil.east.verizon.net
pool-64-223-19-146.prov.east.verizon.net
port30.cvx1-sto.ppp.netlink.se
ppp-1-102.chel-5800-6.access.uk.tiscali.com
ppp-225-85-73.friaco.access.uk.tiscali.com
ppp140-105.dialup.mtu-net.ru
pr8-ts.telepac.pt
proxy.ord.marketscore.com
proxy.rete039.it
proxy2.pinellas.k12.fl.us
richardson-150pc5.ak.pac.army.mil
sc-24-24-236-52.socal.rr.com
sc-66-27-11-57.socal.rr.com
sc-66-74-234-178.socal.rr.com
signup.sonnet.co.uk
spider12.ewatch.com
spider13.ewatch.com
spider20.tiscalinet.it
spider7.ewatch.com
stara68.pip.digsys.bg
sync03.avantgo.com
sync04.avantgo.com
sync07.avantgo.com
sync08.avantgo.com
sync10.avantgo.com
sync11.avantgo.com
sync15.avantgo.com
sync17.avantgo.com
sync18.avantgo.com
sync19.avantgo.com
sync20.avantgo.com
sync22.avantgo.com
sync26.avantgo.com
sync32.avantgo.com
sync33.avantgo.com
sync34.avantgo.com
trt-on66-091.netcom.ca
u74n131.ant.eastlink.ca
user-1120tgp.dsl.mindspring.com
user-2ivficf.dialup.mindspring.com
user-37kadnf.dialup.mindspring.com
user166.net117.lv.sprint-hsd.net
vip.tvc.ntl.com
watcher.lan.onvoy.com
webcacheB01a.cache.pol.co.uk
webcacheM08b.cache.pol.co.uk
wirtanen.iol.it
wks-65-27-15-140.kscable.com
woh-65-28-242-235.woh.rr.com
www.bigorangebob.com
www.linkswap.co.uk
wwwproxy.BelWue.DE
xisrch.sca.isc.cw.net
zeus.unicefusa.org

[littleman]

Prozz, how do you separate the good from the bad bots?