Forum Moderators: open

Message Too Old, No Replies

Unknown robot.

63.229.140.41 - ....../1.0

         

skirril

7:12 pm on Jan 29, 2001 (gmt 0)

10+ Year Member



I have been hit by an unknown robot.

63.229.140.41 - - [29/Jan/2001:19:08:23 +0100] "GET / HTTP/1.0" 200 6165 "-" "Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 )"

The robot does not read robots.txt, hits every 6-7 seconds, and is not too smart on what it gets (gets documents twice or three times.)

The robot grabs everything linked (.html,.shtml,.pdf,.jpg ..)

Ideas?

Froggyman

8:54 pm on Jan 29, 2001 (gmt 0)



I came up with this:

[americablock.com...]

Don't know what it is, maybe another anonimizer proxy???