Mercator-2.0 took two enormous gzipped tar files from our server this weekend. I had no idea a search engine spider would do such a thing. What a waste of bandwidth. Anyone else see this?
I guess now I'll have to move them into an off-limits directory...