Forum Moderators: open

Message Too Old, No Replies

inktomi slurp robot.

si1006.inktomisearch.com

         

jackobar

2:33 pm on Jul 10, 2003 (gmt 0)

10+ Year Member



any body had this in log file..I 'am hoping its to get indexed for inktomi .
it only hit me once.
si1006.inktomisearch.com - - [10/Jul/2003:13:00:47 +0100] "GET /robots.txt HTTP/1.0" 200 0 "-" "Mozilla/5.0 (Slurp/si; slurp@inktomi.com; [inktomi.com...]

my robot.txt file is empty.

jackobar

3:07 pm on Jul 10, 2003 (gmt 0)

10+ Year Member



[inktomi.com...]
on this site,,,its owned by yahoo..so that may the answer...yahoo maybe puting directory entires onto inktomi.
I hope.