mivox - 1:16 am on Jan 25, 2002 (gmt 0)

I've heard there are a few minor spiders who take the absence of a robots.txt as a universal "disallow," but I don't know if that's still the case.

At any rate, none of the major spiders will let a little thing like a missing robots.txt stand in their way, AFAIK