Snapchat influencer Caryn Marjorie put out a chatbot, CarynAI, supposedly based on herself. You could talk to the robot Caryn for $1 per minute! CarynAI took in $70,000 in its first week. Marjorie …
Marjorie now has a few hundred people (people who clearly can't discern fantasy from reality in their emotional lives) who have become obsessed with her based on a fantasy...an avowedly uncomfortable, very horny fantasy that they've each invested thousands of dollars into. Surely that could have no possible pitfalls or dangers whatsoever.
On the bright side, it isn't like Marjorie interfered with a video game that they really like...oh, um...uh oh.
it would help if you could state your position more clearly. (in case of caryn marjorie, it was clearly not what she wanted, which should be enough, and that before we even consider the ethics issues built-in into the technology.)
A friend was just telling me about these Tiktok dance cults where they house young people and pay them to do dance videos all day. They're young, get to do what they want, live in a big house, and get paid well.... today. You know, ask young gymnists and other sports figures how the retirement plan for young physcal performers is after your handlers have sucked every bit of money out of you there is.
But how could you tell these kids otherwise? It's not like sex workers (or any workers really) have infinite choices. You take what pay you can get sometimes to do what work there is. And when that work is hyper-exploitative but still better than any other offer around, what are you supposed to do? It's be exploited and have your personality stolen to sell to other sex-starved, alienated proletarians; or starve. What a choice.