Forum Moderators: phranque

Message Too Old, No Replies

Is this a bad guy?

Or is AOL crawling the web.

         

Powdork

5:20 am on May 26, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



64.XX.186.204
Crawled my entire site today. The IP shows up as belonging to AOL but it stayed the same all the way through, unlike any AOL visitor I've ever seen. Also, it lists the address as Manassas Virginia rather than Dulles, which is what I usually get with AOL.

marcs

5:45 am on May 26, 2004 (gmt 0)

10+ Year Member



What is the USER_AGENT?

Powdork

6:14 am on May 26, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Doh!
(compatible; MSIE 6.0 compatible; Asterias Crawler v4; +http://www.singingfish.com/help/spider.html; webmaster@singingfish.com); SpiderThread Revision: 1.9"

Multimedia spider that does provide content to AOL.