si4000.inktomi.com - - [14/Jul/2001:09:25:47 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si4000.inktomi.com - - [14/Jul/2001:09:25:47 +0100] "GET / HTTP/1.0" 200 654 "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
j6001.inktomi.com - - [14/Jul/2001:09:26:38 +0100] "GET / HTTP/1.0" 200 654 "-" "Mozilla/3.0 (Slurp/cat; slurp@inktomi.com; [
inktomi.com...]
si4002.inktomi.com - - [14/Jul/2001:09:26:39 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si4002.inktomi.com - - [14/Jul/2001:09:26:40 +0100] "GET / HTTP/1.0" 200 654 "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si4001.inktomi.com - - [14/Jul/2001:09:27:01 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si4001.inktomi.com - - [14/Jul/2001:09:27:04 +0100] "GET / HTTP/1.0" 200 654 "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si3002.inktomi.com - - [14/Jul/2001:09:29:05 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
si3002.inktomi.com - - [14/Jul/2001:09:29:07 +0100] "GET / HTTP/1.0" 200 654 "-" "Mozilla/3.0 (Slurp/si; slurp@inktomi.com; [
inktomi.com...]
is it normal for inktomi to try so hard?