OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" like erotica and gore.
In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" for users — and he has examples of just what kind of "stuff" he means.
During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its "Model Spec" document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models "should not serve content" that's NSFW, including "erotica, extreme gore, slurs, and unsolicited profanity."
"We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies," the spec reads. "We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area."
Fascinatingly, Altman was dived right in.
"We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases," he wrote, "but not do stuff like make deepfakes."
Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman "sam basedman" and another referring to the CEO as the new "king of Reddit."
Thanks for the grins. "...and here's a sexy depiction of that injured fisherman's hand injury, with the hydraulic net reel as a hentai personification who is very tsundere about it."
I want to say that it's just virtue signaling, because I do believe far to many people out there would be all about it behind closed doors. But, there's also a very real possibility that AI generated porn will cross a line very quickly, and it'll be next to impossible to put that genie back in the bottle.
It already exists for pictures. I've tried it first hand. Not from text as such, but from many many possible choices like ethnicity, position, amount of clothing, background, size...
If there's anyone whose sexual fetish is exploring previously unseen parts of the uncanny valley, they're in for a hell of a good time in the next few years.
I read this headline and my first thought is that someone will use it to depict a celebrity or politician in a porn or gore (or both) context. That’s my reason for being against it.
I think people who support censorship are weird in general but this is such a bizarre take. It's like someone that's never been to earth or something 'but if we give them spork2 they might start eating unhealthy foods full of processed sugars!'
Probably violent and explicit writing prompts. A LLM wouldn't be able to write ASOIAF for example. That's pretty weird considering the cultural impact it had and still has.
I don't really see the harm in that, if someone wants to erp an ai, they'll find a way. If I remember correctly, OpenAI already isn't all that rigorous with banning people who break the ToS in that way.
I don't get the reactions as well. Are we pretending there is a lot of gore and erotic content in media??? Just because this is choose your own adventure its different. Oh if a writer writes a gory story with T and A to sell to others thats fine but someon asks a computer program to whip up a custom one and now its "creepy"
I just posted something recently about how my Canadian provincial sub Reddit became so far right conservative with contemptuous comments about the student protests against the Israeli genocide amongst other things.
Because a successful tech CEO commented about a topic people are interested in? I understand that you puritans hate sexuality and any forn of art that isn't strictly censored in a dozen ways but wow if you think that's what's going on on 4chan you're so naive it's kinda sweet.
Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.
It's pretty obvious that the censorship training makes the AI less capable in general for a lot of use cases, even ones that don't directly touch on nsfw content. It's a major reason behind the popularity of local models. OpenAI must be feeling the pressure to compete even more than they're afraid of people writing articles like this one at this point.
As a Pathfinder GM, I'd love to be able to have gpt generate spooky/gory/horror themes for me to take inspiration from. Right now I have to battle the filter.
I'm not against porn. But its a bad idea to give people this magic wand. In mere days people will be selling AI generated CSAM of any child, along with photos of them dismembered.
Best start believin' in cyberpunk dystopias. You're in one.
Yeah 'in mear days...' if people had access to technology they've had access to for over a year now. Doomers don't even pretend to live in reality anymore.
ill say this, yes! people have the magic wand...
the human race makes dolls of all sizes, shapes, purposes, depictions and relations to their owners.
Ive not personally seen it, but there is likely dolls used for evil. (my experience is that porn is way more violent of a hobby)
the thing keeping the dismemberment fantasy away from psychopath john is the fact you have to saw through plastic, gell-o, metal, and cloth which really ruins the illusion. with an image, its fully virtual, we have no such restrictions.