heini - 11:01 am on Nov 14, 2003 (gmt 0)

From what I see in my logs the FirstPage crawler has been in charge for index page checking. Deep indexing was from FAST-WebCrawler/3.8.
That one, WebCrawler/3.8./Fresh, really lives up to it's name, it comes daily.

Fizzy, there have been several reports lately of sites where only the robots txt gets checked but nothing indexed, even for well linked sites.
Frankly I don't know what the problem is. It might have to do with the behind the scenes working at OV.
We have heard the frontend serving Altavista and ATW has been merged. The bigger question is what about the backend?