Forum Moderators: bakedjake

Message Too Old, No Replies

I think a spider is going crazy on my site

but whos spider is it?

         

zeus

5:29 pm on Oct 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Something is spidering my site wild right now, but I dont know it, here is the IP 205.188.209.169 Agent: Mozilla/4.0 (compatible; MSIE 5.0; AOL 6.0; Windows 98; DigExt)

here is the other:
205.188.208.133 Mozilla/4.0 (compatible; MSIE 5.5; AOL 7.0;TargetAOL7.0; Windows 98; YComp 5.0.0.0)

whos spider is it or is it a quick surfer on the page.

zeus

NeedScripts

5:31 pm on Oct 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is an AOL IP - not a spider. I guess, someone might be using highspeed aol service and spidering your web site using some software?

zeus

5:34 pm on Oct 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I thought something was wrong there, but why is some going through my site with a software, what could anyone get out of that?

zeus

bobriggs

6:10 pm on Oct 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just as NeedScripts said. It's not a spider. The IP addresses are the AOL Cache/Proxy server(s). If you think the activity is high, or resembles a spider, it's because you just have a bunch of different AOL users on your site at the same time.

zeus

6:19 pm on Oct 13, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



thanks Bobriggs and javascripts, so that means those 2 IPs could come from different people more then 2. It was just that the 2 IP was on my maybe 20 site in 2 min.

thanks

zeus

P.s I`m not that into IP adresses and spiders.