Forum Moderators: phranque
From a user standpoint, I can see the benefit of this exisitng.
From a webmaster standpoint, I don't think I like it. My site is still live and anything that was ever available on it still is. Links on their archived version access other pages on their archived version. At no point do you end up back at my site.
What gives them the right to reproduce my entire site and multiple times at that? Pretty soon they'll be ranking higher than I do for my own pages.
I guess I'll exclude their robot but I'm wondering why I haven't heard any outrage about this. It seems like the equivalent of scanning every page of every edition of a newspaper and making it available to everyone online for free all at once. That's a very different thing from buying a copy and making it available to one person at a time, which is what standard libraries do.
But I did get some interesting results when I tried searching for WmW!
I don't know if excluding the bots will help, they seem to have lots of content already. It must have come from somewhere.
I tried some of my sites, I was surprised to see MANY results. Some going back to 1999!
GASP!
but the site has been around from at least Two years.
and the robot.txt has a noindex and noarchieve for www.archive.org
but good old google's cache shows the optomised page and the cloaking tech.;)
DaveN
Maybee I am missing the point but it all seams like a total waste of resources to me.
