I just noticed I was spidered from 131.137.245.197-200, all 4 IP's, at the same time. Didn't get much (ignored robots.txt, so they got banned) but I thought it weird that it was going on in parrellel.
IP resolves to: Defence Research Establishment-Ottawa
Any ideas on THAT one?
dave
Air
4:44 am on Sep 14, 2002 (gmt 0)
They do research for the Canadian military. There's one near where I live, if you like I'll go over tomorrow and ask them what they are up to ;-)
littleman
11:27 am on Sep 14, 2002 (gmt 0)
What were the user agents for the requests?
carfac
6:33 pm on Sep 14, 2002 (gmt 0)
UA: "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
Air... I cannot figure what they would want with my site...
dave
Lisa
7:10 pm on Sep 14, 2002 (gmt 0)
Well, I just got spidered by 612 IPs all at once! And they were coming from multiple netblocks. Talk about deep scanning, they were requesting results from my search engine for every four character word there was. I have a ban on every IP now, but that was not fun. :(
Air
12:51 am on Sep 15, 2002 (gmt 0)
I'm not sure what they want, but their bot(s) are badly behaved, they deserve to be blocked. 612 all at once Lisa? Were the IPs sequential from those netblocks?
I wonder if they got hacked ...
Lisa
2:07 am on Sep 22, 2002 (gmt 0)
They were querying the site using my own parameters and all the settings were correct for maximum results. They were coming from multiple net blocks like 20-30 per block. It was very impressive technically. I wish they had just sent me an email so I could have talked with them. My system is very capable of fighting 1 IP attacking me. My system was not designed to fight back against a distributed attack. But now it is. :) Unfortunately for them they made it on to my permanent black list, and there is no getting off of that one.
