I'm not sure I understand this. Just because I buy/sell a domain in 2014, that doesn't give me the right to retroactively change what was there in 2007.
Would like to hear more about the basis for such a policy, whose only use case seems like censorship of the past, which Archive is clearly not aligned with.
Speculating on motivations, they are resource constrained. Spending resources keeping thousands of pages available to the public is a reasonable tradeoff vs entering/inviting a protracted legal battle.
As far as the mechanics of it, they follow a policy that explicitly recommends respecting robots.txt:
Would like to hear more about the basis for such a policy, whose only use case seems like censorship of the past, which Archive is clearly not aligned with.