I think the fully autonomous weapons systems restriction is not a very serious one and is very easy to circumvent.
What if you can hire a human to push a single approve button? And what if that human's job is to front load approvals by pressing the approve button a few thousand times, every morning?
Yeah, but then responsibility for the consequences of action of the system falls onto person pressing the button. I hope that no one would be willing to take such responsibility without second thought.
What part of placing a human in the loop requires telling that human what they’re approving, or even that they are approving something? Pressing a button could be as simple as following orders—or giving orders.
What if you can hire a human to push a single approve button? And what if that human's job is to front load approvals by pressing the approve button a few thousand times, every morning?