Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: open
Webmasters can block the archive if they choose.
someone had acquired the domain name . . . and downloaded the original site from the Internet Archive and put it back onlineI am filled with admiration.
their crawler is respecting neither the robots.txt directives nor the noindex tag“Block” doesn’t mean put up a sign that says No Admittance, or Employees Only. It means deadbolt the door.