Yesterday i noticed this in my userlog.
38.70.218.** - - "GET /index.html HTTP/1.0" "http://www.example.com/example.html" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1".
It crawled my site for a long time, only asking html pages. It came from one of my link partner site.
So my guess is either it is a spambot or a linkchecker.
I tried google-ing, but could not find any answer.
anybody else did notice it?
[edited by: volatilegx at 1:59 am (utc) on Dec. 16, 2007]
[edit reason] obfuscated ip address [/edit]