Forum Moderators: open

Message Too Old, No Replies

obot spidered by 5 day old site

         

coffeelover

7:37 pm on Mar 15, 2003 (gmt 0)

10+ Year Member



I just opened a site, and it was spidered by obot... How can it be this thing in Germany if I have only submitted my site to yahoo, google, zeal a few days ago, and put a link from my other site? I was also hit my Looksmart right afterwards, and a few days ago by Google.

Here is the log:

213.252.152.12 - - [15/Mar/2003:08:42:36 -0500] "GET /robots.txt HTTP/1.1" 404 290 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)"
213.252.152.12 - - [15/Mar/2003:08:42:37 -0500] "GET / HTTP/1.1" 200 1468 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)"
213.252.152.12 - - [15/Mar/2003:08:42:37 -0500] "GET /headline.gif HTTP/1.1" 200 5072 "http://wwWebmasterWorldebsite.com/" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)"
213.252.152.12 - - [15/Mar/2003:08:42:37 -0500] "GET /cg_banner468_1.gif HTTP/1.1" 200 12182 "http://wwWebmasterWorldebsite.com/" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)"
sv-fs1.looksmart.com - - [15/Mar/2003:12:26:28 -0500] "GET / HTTP/1.0" 200 1468 "-" "MARTINI"

Would the last one be a Zeal editor, maybe?

Thanks.

Theodore

fiestagirl

8:50 pm on Mar 15, 2003 (gmt 0)

10+ Year Member



MARTINI is a link checking robot from Looksmart. The Zeal robot has Zealbot or something similar in the user agent.

weesnich

9:11 am on Mar 16, 2003 (gmt 0)

10+ Year Member



It it is cobion as I suspect: they sell some cooperate filter boxes which report by default unknown urls (visited by surfers in the companies using them) back to cobion for checking.
If you had some traffic through such a box with reporting enabled...