Forum Moderators: phranque
I'd recommend you look into automated access control, rather than trying to get a list of IP addresses. See message #16 of this recent thread [webmasterworld.com].
Jim
We have identified from our logs many troublemakers on small country specific ISP’s, some on satellite ISP’s and we’ve tried to used the CIDR ranges to subsequently block them. It’s always reactive and recently we’ve seen AOL connections that always resolve to Dulles so I was wondering if we could better understood that network well enough to isolate blocks or find out where the real connections are coming from with out blocking all AOL users?
The scripts in the thread I cited may help a great deal to get you out of your 'reactive' mode. They trap bad user-agents by robots.txt violation and by excessive access rate, and automatically add entries to your .htaccesss file. You can then come along *at your leisure* and inspect the latest intrusion attempts, consolidating idividual IPs into ranges or CIDRs after looking them up in ARIN, APNIC, RIPE, etc. But the blocking action is almost instantaneous, so you can leave your site and take a few days off without worrying about it.
Up until last month, I used one of the satellite ISPs, and my requests would have been mixed in with those of many other countries. Thankfully, I now have point-to-point microwave service, which avoids the 480 millisecond air-time latency and congestion of satellite ISP service. But be careful and don't block my neighbors, OK? :)
Anyway, I gave up trying to unravel AOL's caching proxy system, so I can't help with that. Maybe someone else has more info that would be useful to you. You could also search for GeoIP and discussions about GeoIP and see if they have any suggestions for AOL.
Jim