Forum Moderators: open
I got tired of this one generating 404 errors and blocked it. But is still comes back daily for the same pages - including the dead ones. Even after months of daily visits, it never learns from 404 or 403 response codes, so I doubt that it belongs to anyone who knows anything about robots. Also, this "unknown.level3" bit in the REMOTE_HOST string is rather unprofessional. Thus, I don't feel bad blocking it without knowing all the details.
unknown.Level3.net - - [18/Sep/2002:17:37:10 -0400] "GET /spevent/reslt.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [18/Sep/2002:18:23:11 -0400] "GET /spevent/reslt.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [18/Sep/2002:21:42:18 -0400] "GET /index.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [18/Sep/2002:21:42:18 -0400] "GET / HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [19/Sep/2002:06:28:02 -0400] "GET /fried.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [19/Sep/2002:18:34:36 -0400] "GET /index.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [19/Sep/2002:18:34:36 -0400] "GET / HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
unknown.Level3.net - - [20/Sep/2002:05:29:33 -0400] "GET /fried.html HTTP/1.1" 403 838 "-" "Mozilla/5.0 (X11; Linux i686; en-US; rv:1.0rc5; OBJR)"
Jim