“We want to ensure that people have maximum control to the extent that it doesn’t violate the law or other peoples’ rights,” Joanne Jang, a member of the product team at OpenAI, told NPR. “There are creative cases in which content involving sexuality or nudity is important to our users.”
The other problem in my mind is the fallibility of current safeguards. OpenAI and rivals have been refining their filtering and moderation tools for years. But users constantly discover workarounds that enable them to abuse the companies’ AI models, apps and platforms.
Some highlights from the article.
It seems like AI porn is inevitable and OpenAI has safeguards in mind for exploitative content so it doesn't seem like a horrendous idea.
to the extent that it doesn’t violate the law or other peoples’ rights
Am I the only one who finds this so weird when we talk about LLMs? If someone makes a bot that resembles some specific person, that person's rights aren't really violated, and since they're all fictional content, it is very hard to break actual laws through its content.
At that point we would have to also ban people's weird fan fiction, no?
Not arguing about whatever they want or don't want on their platform, but the legal & alleged moral questions / arguments always weird me out a bit, because there's no one actually getting hurt in any sort of way by weirdos having weird chats with computers.
The bigger issue is the enforcement. Either you monitor an absurd amount of content, which is worse for privacy, or you straight up censor the models, which makes them typically restrictive even in valid cases / scenarios being played out (other platforms went through this, with a consequential loss of users).
Am I the only one who finds this so weird when we talk about LLMs? If someone makes a bot that resembles some specific person, that person’s rights aren’t really violated, and since they’re all fictional content, it is very hard to break actual laws through its content. At that point we would have to also ban people’s weird fan fiction, no?
Not arguing about whatever they want or don’t want on their platform, but the legal & alleged moral questions / arguments always weird me out a bit, because there’s no one actually getting hurt in any sort of way by weirdos having weird chats with computers.
I could see some people making the argument that it could be considered defamatory especially in cases where it is being peddled as real. Politicians might even try to link it in with revenge porn or other non-consensual pornography laws.
It would sure get messy in a hurry though. Imagine someone trying to make lewd photos of Tomb Raider's Laura Croft for example and accidentally generates images resembling Alicia Vikander or Angelina Jolie from the Tomb Raider movie.
Potentially tin foil hat thoughts; but it bugs me too. I also believe we will be the last generation with this problem though. Progress is only a few gravestones away.
First, at it's root this isn't a problem that we can solve. You can run ai locally, it's distributed already, and can be completely run offline. Big brother aside it's part of reality now. Since we can't solve it, that means we have to adapt. In this scenario we likely change what is socially considered taboo. Generated content by definition is not a real person, it's actively being pursued. I'm sure there needs to be more research into the long term effects of AI, but there could even be positives. One of the learnings from the reddit pedophile ama was that unhealthy people can feel ashamed and desire a safe outlet. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8888370/ A fake person appears to be a potential solution.
Second and likely the slowest to change is shame of nudity. Some cultures accept it, I'm personally happy we that we make people cover themselves just for sanitary reasons. But the religious agenda has pushed shame and when anyone can generate nudes, why care?
That's the crux of the problem: they'll make it so you can't (as for any other celebrity) but there is a high risk that the safeguards can be circumvented.
Just train a couple LoRAs and you can add in the vectors needed for doing whatever you want. "Circumventing" "safeguards" in this case means using a feature built into the system already. I have been making AI porn from the start. The day in installed their local framework for using it and got a Rick Astly image instead of anime tits I went and found their censorship function and neutered it. It is just python code, super easy to do.
Good question. That is (almost certainly) political speech and as such especially protected by law. It's also quite controversial and so companies will try to prevent their services being used for it.