herb - 10:34 pm on Apr 1, 2005 (gmt 0)
Y sent one of our sites 635 visitors a day on average for March. At its current rate we should make 432 for today. Yesterday it was showing 2340 pages in the index, today it's at 660. Strange thing, slurp picked up 18,000+ pages in March. I was expecting great things on this update. I wonder, if I had banned slurp in robots.txt would the 2340 pages still be there.