Grumpus - 8:01 pm on Aug 26, 2002 (gmt 0)

I don't know that it "never" will - well, actually, I do - it won't. I've got over a million pages. What it means is that I don't know what determines which pages get crawled and which get put into the index. It's fairly obvious that at least one of their seeds is the DMOZ, but beyond that, I have no clue. Content doesn't mean much, either. I've got pages with little or no information on them (i.e. Such-and-so played "Webmaster #1" in "Hackers" or something where there just ISN'T info) that have made it into the index, and then there are pages that are popular, are indexed in several directories and search engines, and HAVE been crawled by INK but just don't appear. <shrug>

It's a mystery to me. I can say I've never seen it enter on a page and start crawling links it comes across like Googlebot does.

G.