OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" like erotica and gore.
In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" for users — and he has examples of just what kind of "stuff" he means.
During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its "Model Spec" document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models "should not serve content" that's NSFW, including "erotica, extreme gore, slurs, and unsolicited profanity."
"We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies," the spec reads. "We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area."
Fascinatingly, Altman was dived right in.
"We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases," he wrote, "but not do stuff like make deepfakes."
Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman "sam basedman" and another referring to the CEO as the new "king of Reddit."
I want to say that it's just virtue signaling, because I do believe far to many people out there would be all about it behind closed doors. But, there's also a very real possibility that AI generated porn will cross a line very quickly, and it'll be next to impossible to put that genie back in the bottle.
It already exists for pictures. I've tried it first hand. Not from text as such, but from many many possible choices like ethnicity, position, amount of clothing, background, size...
If there's anyone whose sexual fetish is exploring previously unseen parts of the uncanny valley, they're in for a hell of a good time in the next few years.
I read this headline and my first thought is that someone will use it to depict a celebrity or politician in a porn or gore (or both) context. That’s my reason for being against it.
I think people who support censorship are weird in general but this is such a bizarre take. It's like someone that's never been to earth or something 'but if we give them spork2 they might start eating unhealthy foods full of processed sugars!'