Trying to read the rawlog, because everytime I saw inktomi in my stats, (not to good) it always stated my robots.txt file.
As far as I can see, reading it, itīs dificult without a program, it stops at robots.txt.....?
Thinking maybe something is wrong with my robotfile...........
this is the text in it:
and here were inktomi explain about the robots file: http://www.inktomi.com/slurp.html
donīt understand to much, but I donīt think I done anything incorrect?