That’s not just society. If you look at nature you’ll notice every organism has weapons. Evolution doesn’t brook wasted energy, and yet every organism spends a big portion of its energy budget building weapons. Think about that.
There's a huge difference between protecting yourself from harm and creating weapons powerful enough to destroy all life on the planet. We're in the second group, no other species even comes close. And all that being said, the drive to procreate is even stronger than the drive to kill your neighbor, so good luck conditioning that out of society.
That's not true. Most organisms spend a big portion of their energy on moving, eating, or just existing. Humans are one of the few organisms capable of creating a weapons.
impossible to enforce and that's if all ai was open. secondly, corporations and companies will never be willing to give out their million dollar AI's for free to the public.
What you really mean there is eliminate all privately-owned AI. Sort of like eliminating all the privately owned drugs, except instead of physical objects you’re targeting software.
So, what do you suppose the budget would be of the office whose task it is to eliminate privately-held AI?