GoogleGuy - 10:49 pm on Jul 9, 2003 (gmt 0)

For that matter, the nytimes.com has a robots.txt that excludes spiders from "/archives" and from archives by year, and Google respects that robots.txt file. We don't crawl those pages. I'm not aware of any archives from the NY Times that Google has crawled. But the article didn't mention any specifics. :(