AI-Generated Data Can Poison Future AI Models - Scientific American
AI-Generated Data Can Poison Future AI Models - Scientific American
As AI-generated content fills the Internet, it’s corrupting the training data for models to come. What happens when AI eats itself?
Cannibalism always has increased risk of brain disease. Seems fitting that this applies to AI too.
I like the term from Jathan Sadowski that it should be called Habsburg AI
So in order for data to be useful to AIs, AI-generated content will have to be flagged as such. Sounds good to me.
But malicious actors don't want their generated data to be recognizable to LLMs. They want it to be impersonating real people in order to promote advertising/misinformation goals.
Which means that even if they started flagging LLM generated content as LLM generated, that would just mean only the most malicious and vile LLM contents will be out there training models in the future.
I don't see any solution to this on the horizon. Pandora is out of the box.
It's basically RE:RE:RE:RE:RE:RE and corrupted jpegs that have been reposted and compressed a thousand times, but for AI.
Dead internet theory seems like a completely inevitable future place that we're all racing to. I don't see any way to avoid it. It's a tragedy of the commons in a place where there is no organizing body that can step in and prevent private actors from destroying everything. Worse, we're more concerned with those private actors being strong and competitive which is only accelerating us towards the doomed endgame.
Great. It'll be easy to tell AI generated content apart when they're just spewing jibberish.