Something is spidering my site wild right now, but I dont know it, here is the IP 205.188.209.169 Agent: Mozilla/4.0 (compatible; MSIE 5.0; AOL 6.0; Windows 98; DigExt)
here is the other: 205.188.208.133 Mozilla/4.0 (compatible; MSIE 5.5; AOL 7.0;TargetAOL7.0; Windows 98; YComp 5.0.0.0)
whos spider is it or is it a quick surfer on the page.
zeus
NeedScripts
5:31 pm on Oct 13, 2002 (gmt 0)
It is an AOL IP - not a spider. I guess, someone might be using highspeed aol service and spidering your web site using some software?
zeus
5:34 pm on Oct 13, 2002 (gmt 0)
I thought something was wrong there, but why is some going through my site with a software, what could anyone get out of that?
zeus
bobriggs
6:10 pm on Oct 13, 2002 (gmt 0)
Just as NeedScripts said. It's not a spider. The IP addresses are the AOL Cache/Proxy server(s). If you think the activity is high, or resembles a spider, it's because you just have a bunch of different AOL users on your site at the same time.
zeus
6:19 pm on Oct 13, 2002 (gmt 0)
thanks Bobriggs and javascripts, so that means those 2 IPs could come from different people more then 2. It was just that the 2 IP was on my maybe 20 site in 2 min.