Yidaki - 3:35 pm on May 17, 2003 (gmt 0)

>links that no longer exist, old domains etc... the new index is full of it.

i've got one lame self coded crawler - latest crawl was one and a half year ago ... that is one index, you could complain about - it's full of old domains and links that no longer exist.

However, if you find even a couple of dozens expired links at google, you can't say "the new index is full of it". Don't forget: some webmasters change their mind / content even more often than google's freshbot is refreshing the index and on the other hand some searches return content that has been removed from it's site days/weeks/months ago but is still very usefull. Good thing is: you can look at the content by looking at the cache version ... 404's are a minor problem to me, as long as there's a cached copy of the page.