We seem to have Zyborg and Inktomi constantly crawling our site. This is every single day and constantly throughout the day. Does anyone have any information on why these two SE do this?
korkus2000
8:02 pm on Nov 20, 2002 (gmt 0)
How many pages do you have? Zyborg likes to assault servers every once in a while. You will probably see that for a couple of days then it will go away. Slurp usually hits over a long period of time. I am not really sure why slurp would pound your site.
