stcrim - 1:38 pm on Oct 16, 2000 (gmt 0)

Hope,

Many people are running into the same slurping situation. You are wise to not want to run robots.txt to slow'er down. At least for us, there has been no benefit, no random pages getting indexed, no improvement in ranking - in fact, it appears slup is just visiting with no purpose (can't be, right?)

We have come to ignore the visits and filter for them in the logs. If there's a better suggestion - I too will look forward to it.

Steve