A South Korean man has been sentenced to jail for using artificial intelligence to generate exploitative images of children, the first case of its kind in the country as courts around the world encounter the use of new technologies in creating abusive sexual content.
Why should it have that? Stable Diffusion websites know that most of their users are interested in NSFW content. I think the idea is to turn GPUs into cash flow, not to make sure that it is all wholesome.
I suppose they could get some kind of sex+children detector going for all generated image, but you're going to have to train that model on something, so now it's a chicken and egg problem.
Earlier this month, police in Spain launched an investigation after images of underage girls were altered with AI to remove their clothing and sent around town. In one case, a boy had tried to extort one of the girls using a manipulated image of her naked, the girl’s mother told the television channel Canal Extremadura.
That was another case in Spain. Not the guy in Korea. The person in Korea didn’t distribute the images.
I really gotta wonder what the difference is between prosecuting someone for their thoughts and prosecuting them for jerking it to their own artwork/generative whatever they kept entirely to themselves. The only bad I see here is someone having their privacy invaded by someone else bigger than them and being put on display for it. Sounds familiar?
Because that was another case. Extortion and blackmail (and in this case would count as production of cp as would be the case if you would draw after a real child) are already illegal. On this case we simply dont have enough information.