Maybe call me ignorant but as someone from Eastern part of the world, sometimes I wonder why would these people worry when all of these AI stuff are still prompted from human input, in a sense that We are the one who creates them and dictates its actions. All in all they're just closed loop automata that happens to have better feedback input compared to your ordinary Closed loop system machines.
Maybe these people worried because these (regular people) don't know how these things works or simply they don't have or lack of self control in first place which what makes them feels like having no control about what happening.
I understand the danger of AI too, but those who prompted them also human too, in which it is just human nature by itself.
While this is true in aggregate, consider Elon's Grok which then turned around and recognized trans women as women, black crime stats as nuanced, and the "woke mind virus" as valuable social progress.
This was supposed to be his no holds barred free speech AI and rather than censor itself it told his paying users that they were fucking morons.
Or Gab's Adolf Hitler AI which, when asked by a user if Jews were vermin, said they were disgusting for having suggested such a thing.
So yes, AI is a reflection of human nature, but it isn't necessarily an easily controlled or shaped reflection of that.
Though personally I'm not nearly as concerned about that being the continuing case as most people it seems. I'm not afraid of a world in which there's greater intelligence and wisdom (human or otherwise) but one in which there is less.
AI is a reflection of human nature, but it isn’t necessarily an easily controlled or shaped reflection of that.
This partly true especially models that deployed on public and uses large samples gathered from large amount of peoples. Now the parts that we can't control is if the model is trained with skewed dataset that benefits certain outcomes.
It depends on which stage of training. As the recent Anthropic research showed, fine tuning out behavior isn't so easy.
And at the pretrained layer you really can't get any halfway decent results with limited data sets, so you'd only be able to try to bias it at the fine tuned layer with biased sourcing, but then per the Anthropic findings (and the real world cases I mentioned above) you are only biasing a thin veneer over the pretrained layer.
This is not some "computers will outpace us" Terminator shit. Algorithms are human dictated. We are the sole architect of our demise, not something else.