Instagram Advertises Nonconsensual AI Nude Apps
Instagram Advertises Nonconsensual AI Nude Apps
Some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies.
Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.
While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.
Seen similar stuff on TikTok.
That's the big problem with ad marketplaces and automation, the ads are rarely vetted by a human, you can just give them money, upload your ad and they'll happily display it. They rely entirely on users to report them which most people don't do because they're ads and they wont take it down unless it's really bad.
It remains fascinating to me how these apps are being responded to in society. I'd assume part of the point of seeing someone naked is to know what their bits look like, while these just extrapolate with averages (and likely, averages of glamor models). So we still dont know what these people actually look like naked.
And yet, people are still scorned and offended as if they were.
Technology is breaking our society, albeit in place where our culture was vulnerable to being broken.
Lot of people in this thread who don't seem to understand what sexual exploitation is. I've argued about this exact subject on threads like this before.
It is absolutely horrifying that someone you know could take your likeness and render it into a form for their own sexual gratification. It doesn't matter that it's ai rendered. The base image is still you, the face in the image is still your face, and you are still the object being sexualized. I can't describe how disgusting that is. If you do not see the problem in that I don't know what to tell you. This will be used on images of normal non-famous women. It will be used on pictures from the social media profiles of teenage girls. These ads were on a platform with millions of personal accounts of women and girls. It's sickening. There is no consent involved here. It's non-consensual pornography.
AI gives creative license to anyone who can communicate their desires well enough. Every great advancement in the media age has been pushed in one way or another with porn, so why would this be different?
I think if a person wants visual "material," so be it. They're doing it with their imagination anyway.
Now, generating fake media of someone for profit or malice, that should get punishment. There's going to be a lot of news cycles with some creative perversion and horrible outcomes intertwined.
I'm just hoping I can communicate the danger of some of the social media platforms to my children well enough. That's where the most damage is done with the kind of stuff.
That bidding model for ads should be illegal. Alternatively, companies displaying them should be responsible/be able to tell where it came from. Misinformarion has become a real problem, especially in politics.
ITT: A bunch of creepy fuckers who dont think society should judge them for being fucking creepy
This is not okay, but this is nowhere near the most harmful application of AI.
The most harmful application of AI that I can think of would disrupting a country’s entire culture via gaslighting social media bots, leading to increases in addiction, hatred, suicide, and murder.
Putting hundreds of millions of people into a state of hopeless depression would be more harmful than creating a picture of a naked woman with a real woman’s face on it.
This reminded me of those kid's who made pornographic so videos of their classmates.
Am I the only one who doesn't care about this?
Photoshop has existed for some time now, so creating fake nudes just became easier.
Also why would you care if someone jerks off to a photo you uploaded, regardless of potential nude edits. They can also just imagine you naked.
If you don't want people to jerk off to your photos, don't upload any. It happens with and without these apps.
But Instagram selling apps for it is kinda fucked, since it's very anti-porn, but then sells apps for it (to children).
Lemmy rolls worst comment section, asked to leave the Fediverse
Plz don look at my digital pp, it make me sad.. Maybe others have different feeds but the IG ad feed I know and love promotes counterfeit USD, MDMA, mushrooms, mail order brides, MLM schemes, gun building kits and all kinds of cool shit (all scams through telegram)...so why would they care about an AI image generator that puts digital nipples and cocks on people. Does that mean I can put a cock on Hilary and bobs/vagenes on trump? asking for a friend.
