GodLikeLotus - 5:42 pm on Jan 13, 2004 (gmt 0)

If you do this search you will some very strange results site:www.oed.com oxford

Their robots.txt was pointed out to me this morning.

There is however a MAJOR problem.
Where is their homepage is the serps? This is not banned by the robots.txt. Also only 4 pages show a cache link in the serps and they are ALL "Page not Found"

Come on Google, I may not know much about this crazy search engine world but I can see this is not right.

Wait, just looked at their homepage
<meta name="robots" content="noarchive">

Maybe they have just decided to ban all robots, why? With this above why is google still looking at some of their pages?