How do we stop china and russia from developing it? How come nobody seems to be talking about the obvious international treaty that would be necessary to actually ban superintelligence from being developed? At least we can deliberate some kind of enforcement mechanism in the process...
By international agreement, obviously. There are tons of international agreements to regulate all sorts of things. It's generally a pretty good way to prevent a race to the bottom. Or in this case, a potential race to the end of the world.
The biggest problem is that the US has shown not trustable when it comes to treaty. You can have a treaty with the US but the US can just use Israel or some other proxy to do the advance research and development for them..
How would it make them worse off? If everybody agrees that AI is a threat to humanity, but also a possible edge over rivals, then the threat should be enough reason to get everybody to agree.
There are international agreements on tons of things that work the same way.
Two things I would say. One: nuclear non-proliferation has been pretty successful; we can use a similar model for AI.
Two, China's major motivation for developing competitive AI isn't to reap the benefits from an an important new technology. It's to undermine the economic development of the West and make them even more dependent upon the CCP. It's an extension of the policy that's made us dependent on Chinese labor and manufacturing: win on the economics by any means necessary, wait for the other producers to die, enshittify (extract geopolitical concessions, in this case).
This is relative to something like every nation owning nuclear weapons by 1960 and civil wars usually beginning with a nuclear strike by a standing government.
Nuclear proliferation is not proper in context. The bill in question in the submission is not about preserving a status quo, it is about banning the technology.
A ban on technology results in underground research, migration of intellectuals, monopolies, seething parties...
I didn't say the challenges would be the same.. You just indicated they were worthwhile for anyone who believes the anthropic principle is why they haven't seen a world with no nuclear treaties decades later.
> nuclear non-proliferation has been pretty successful; we can use a similar model for AI.
Development of nuclear weapons has continued, and a lot of effort goes into developing delivery systems.
A number of countries have acquired nuclear weapons over the years: India, Pakistan, Israel, South Africa, North Korea. More countries have kept their options open and could develop nuclear weapons if needed.
After over 80 years since the US used nuclear weapons against Japan, less than 5% of the world's countries have nuclear weapons, and no one's used one on another country since. If you don't think that's an incredible achievement you're unserious.
My point is that it has worked for nuclear weapons because there are deterrents to using them. The acknowledged nuclear powers have all pledged to only use them in self defence. No one is going to develop AI and not use it.
Oh, that's easy. Bernie will pick 11 volunteers and together they will be dropped off behind enemy lines. Let's call them "the Dirty Dozen". They will capture the evil bastards who violated American law outside of US borders (that's just evil) and bring them to Justice™ (Impossible is nothing. Call 1-800-JUSTICE. Conditions apply).
> the obvious international treaty
That's even easier. We just take the international treaty on cloud computing as a base and...
The point is an arms race is bad for everyone. "I don't know what WW3 will be fought with, but I do know WW4 will be fought with sticks and stones" type of stuff.
I assume the US will also ban the use for foreign models as part of this.
Pausing development means the people with the currently most advanced models are shielded from competition, especially if foreign competition is not allowed.
A new agency will impose heavy regulation which can easily be twisted to favour incumbents.
Man, it would be awesome if I could tell my boss “No, I don’t want to go to prison for 20 years” when they ask me if some magical AI thing can be done.
And members of the Dems give further gifts to the opponents.
Question: how aware are they?
Given the missed "intellectual solidity" of the submitted proposal, there is a chance that their effective support to the other party is not conscious.
And in terms of civilization, the confrontation is downgraded to ventral partitism, hysterical: "not like it" vs "really want it or do not mind".
The USA should finally revise their system and create more parties. It is absurd that power be left bouncing on the rhythm of "never this, we'll pick whatever that".
I think the other fellas covered it but are 4 functions a broad range? My scientific calculator does way more than that. My graphing even more. It's too open ended. It would become one of those laws that's just used to prosecute whoever they want and not one that anybody could tell you definitively if you'll be violating or not
The HN title has been editorialized... and techno-oligarchs really, really hate Sanders.
The bill isn't about using LLMs to merge your pull requests, it's about discouraging people or companies who might be working on their own private Manhattan Projects from intentionally trying to create the impact equivalent of nuclear weapons, or "Artificial Superintelligence".
We're getting closer than not to an A(S)I arms race. Sanders has lived his entire life in that, and I've been smelling it for a while, too.
This person has missed reading classes, is dishonest or just stupid. The law proposal bans research on ASI, and sets penalties for those who transgress the ban. Seems quite obvious to me. The law that bans clandestine efforts to build nuclear weapons is not "proposing to sentence nuclear physicists to 20 years in prison".
(Btw, "up to" doesn't mean "to". Second comprehension mistake in a few lines- I bet all current generation of LLMs have better understanding.)
Which is exactly the same as the submission's post, obvious interpretations of "AI" aside: how can we implement Intelligence without enabling superintelligence at the same time?!
And of course we must implement Intelligence, finally: we have implemented further morons, of which we already had plentiful abundance - already the LLM stage must be corrected!
We might agree or disagree with the statement that AGI and ASI are dangerous (economically, societally, existentially) and research needs to be paused- which means making their development (temporarily) illegal. If you accept that it is the case, though, you need to accept that there are penalties for those who violate the law.
Developers are mostly fine, they are already buried in work and won't stop to question long and hard enough. It's the managers and sci-fi grifters that make this entire topic toxic, by assuming no limits should apply to them.
and farmers too! Did you know they just steal the resources they need to grow our food? They don't pay anything for sunlight or air! Who's investigating them?
reply