Sneaky Fast Spider

Forum Moderators: open

Message Too Old, No Replies

9:52 am on Nov 12, 2002 (gmt 0)

Hi....

Got this one yesterday:

IP: 65.198.110.5
UA: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)

7:36 am on Nov 21, 2002 (gmt 0)

Sure it was a spider and not a human?

10:03 am on Nov 21, 2002 (gmt 0)

Requested robots.txt -- not many people do that!

4:33 pm on Nov 21, 2002 (gmt 0)

Josk:

I sometimes do... but usually on big sites. (or, my competition!)

dave