An in-depth police report obtained by 404 Media shows how a school, and then the police, investigated a wave of AI-powered “nudify” apps in a high school.
An in-depth police report obtained by 404 Media shows how a school, and then the police, investigated a wave of AI-powered “nudify” apps in a high school.
The indifference of AI advocates is just apalling too. "It's going to happen anyway, they just gotta get over it, it's not real."
Teens can barely get over mild perceived embarrassment, nevermind having porn replicas of them spread around, and having to deal with related harassment. I dread how that will affect them.
There was an article 2-3 months back about a small town in Spain being torn apart by this kind of thing and I braced as I knew it couldn't be long. What a time to be a kid or parent.
Yep. My school years predate social media and mobile phones were pre smartphones. Shit cameras etc.
but the rumour mill was vicious and damaging. Very hard to prove the truth when the lie is so salacious. The more you denied it the more it seemed true.
These poor kids. How do they defend against this shit.
Just when I get the feeling kids these days are a little more tolerant than the last generation, NOPE! "Hey Chris! Watch this 5-min long video of our teacher taking a troll cock!"
1.) Germany has civil laws giving a person depicted similar rights as the creator of an image. It is also an criminal offense publishing images, that are designt to damage an persons public image, Those aren't perfect, mainly because there wording is outdated, but the more general legal sentiment is there.
2.) The police traces the origin through detective work. Social Cycles in schools aren't that huge so p2p distribution is pretty traceable & publishing sites usually have ip-logs.
A criminal court decides the severity of the punishment for the perpetrator. A civil court decides about the amount of monetary damages, that were caused and have to be compensated by the perp or his/her legal guardian.
People simply forwarding such material can also be liable (since they are distributing copyrighted material) & therefore the distribution can be slowed or stopped.,
3.) It gives the police a reason to investigate, gives victims a tool to stop distribution & is a way to compensate the damages caused to victims
I can better explain what I don't want out there, and we've already seen some pretty awful shit. This will usher in a completely new generation of CSAM, bullying, harassment, and political sabotage. It seems we should have some protections or penalties in place to cover such things.
I kinda doubt porn would be a problem with Sora, just like it's not a problem with Dall-e. The model is locked down in openai's servers and open source model is no where as good yet. Even if there is a comparable downloadable models, it'll be computationally expensive I doubt teens can freely run it.
By the time a law would be adopted, it probably will be. I wouldn't want to rely on the "kindness" of commercial entities as the sole protector of consumer welfare. We've seen how well that works with Google and Facebook.
Even if there is a comparable downloadable models, it'll be computationally expensive I doubt teens can freely run it.
For now, but with every new tech, hardware efficiency optimization is not too far behind. Especially considering the performance required for training != performance required for running/outputting.
Considering the glacier speeds our government moves, I'd bet on those hardware efficiency optimizations making it out before any significant law gets implemented.
Sure - they try to prevent that stuff, but it’s hardly perfect. And not all bullying is easily spotted. Imagine a deepfake of a kid sending a text message, but the bubbles are green. Or maybe they’re smiling at someone they hate.
Also, stable diffusion is more than good enough for this stuff. It’s free and any decent gaming laptop can run that. Takes mine 20 seconds to produce a decent deepfake… I’ve used it to touch up my own photos.
I’m so relieved to be an average or maybe slightly below average looking adult male with an established career. It would be hell being a teenage girl in today’s world.
AI should never have been allowed to get where it is without a system in place to control it. But that’s how these things work. So… no one should really be surprised that assholes will utilize for the the greater goal of worsening of civilization for their own amusement.
Can I just say that I'm relieved the DA didn't charge these kids and ruin their lives. Not that it's not horrible for the victims, there should be consequences. Bullying in the US is out of control, but police and justice system are not the answer. Make this a teachable moment about consent. These app makers should be brought to account, don't take it out on some stupid kid who put in a photo of their classmate. Too often do we hear of cases in the US justice system where youthful stupidity begets a ridiculously harsh response, especially when involving drugs for example. Mandatory reporting is needed to prevent corruption, but that doesn't mean I trust the government to not fuck up these kids for life.