Stubsack: weekly thread for sneers not worth an entire post, week ending Sunday 27 October 2024
Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.
Any awful.systems sub may be subsneered in this subthread, techtakes or no.
If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.
The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)
Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.
PM is down to let us pitch them our argument. Good news: PM seems like a cool person, is open minded, and is being pretty frank about the forces at work here. Bad news: taking action on this will open a whole can of worms, so any proof has to be ironclad. After conferring with our local grant wizards, the battle plan is to crank out a 15 minute pitch consisting of:
a 2 min elevator pitch of our tech, highlighting what the reviews mangled
intro to LLMs for people who know what glycosylation is
intro to semiotics for the same
show how transformer architectures transform symbols into symbols to produce text-shaped objects without actual intent, ideas, or context (and why "automated AI detection" is also bullshit).
show a few examples of plausible-at-first-glance gen-ai slop (the nonexistant turkish fortress, mouse dck, etc)
Highlight how our weird reviews (both good and bad) fit exactly into this bin (absolutely mis-interpreting a table, inventing a bacterial species we didn't use and talking shit about it, miscounting our team members, etc)
We'll be leaning on the Stochastic Parrot paper pretty hard, because it's a good entry into the field on the skeptical side and is just well constructed in general. I'm also on the hunt simplified diagram for how LLMs convert tokens to arrays to tokens from the original transformer literature. Unfortunately, so much of the literature is obscurantist on purpose, and I want to avoid falling into the "It can't be that stupid" trap. Any pointers in that direction are most welcome!
Actual message I got while renewing my insurance plan last night. Thank you for adding a shitty chat bot which will give me false information about my life and death decisions, bravo.
They're trying to defend this by saying that all of the hosts were just independent contractors and AI is not the main reason they're firing them, and that the AI thing is just going to be "an experiment to appeal to Gen Z". Fortunately, most people's response seems to be "fuck off with this crap".
I just... can't with this. Even if they really were firing the hosts anyway (which is possible), I absolutely hate that they are using public money to run "experiments" with AI media. Heads should roll for this.
Gizmodo just reported on the story - in addition to the suicide that kicked this litigation off, they've also discovered an hour-long screen recording where a test account (self-reported as thirteen years old) gets sexted relentlessly by the site's chatbots.
So, in addition to driving one specific teen to suicide, character.ai is also facing accusations that their bots are sexually harassing children.
Penguin Random House (PRH) has amended its copyright wording across all imprints globally, confirming it will appear “in imprint pages across our markets”. The new wording states: “No part of this book may be used or reproduced in any manner for the purpose of training artificial intelligence technologies or systems”, and will be included in all new titles and any backlist titles that are reprinted.
Now that the content mafia has realized GenAI isn't gonna let them get rid of all the expensive and troublesome human talent. it's time to give Big AI a wedgie.
“There are around three dozen lawsuits by media companies against generative AI tools. The common theme betrayed by those complaints collectively is that they wish this technology didn’t exist,” said the Perplexity team in the blog. “They prefer to live in a world where publicly reported facts are owned by corporations, and no one can do anything with those publicly reported facts without paying a toll.”
I wish the AI bros at Perplexity and elsewhere a very cope and fucking seethe.
Okay, quick personal sidenote:
With how much misinformation, manipulation, outright theft and other horrific shit this AI bubble has caused, I suspect we're gonna see some attempts at an outright ban on AI. How successful they're gonna be, I don't know, but at the bare minimum it'll enjoy some popularity on the political fringe.
related notesfrompoland and onet article they probably referenced (in polish) and another. would you guess that they fired a dozen or so* people just before? (and somehow had money for whatever horseshit they were sold) small radio stations aren't probably bringing serious money either way now
homepage of that radio boasts about their "almost entirely created by AI" content. it looks like they tried to convince zoomers to get an FM radio and listen to it somehow. it's gonna go great
*original report used very handy word that does not appear in english that one could translate as "fewteen" and can mean any number from 11 to 19 inclusive
US forest service cuts thousands of jobs. Not to worry, the bright hackernews are on it! just install an AI data center in the forest!. Seriously though, I can't tell if this is brilliant satire or not.
Like the copyright situation I previously mentioned, I suspect this is also gonna make potential investors wary of investing in AI post-bubble. Even if you manage to convince investors that you won't get DMCA'd into oblivion, they're still gonna be wary of the potential for a Dasani-level PR nightmare.
Of course, that's assuming that Section 230 protects you from being held liable for what your autoplag does - if Ms. Garcia, whose son's suicide prompted this entire mess, succeeds in court, the legal precedent set means you're likely gonna have to worry about being sued if/when someone ends up injured/killed/defamed/otherwise fucked up because of its output..
Whatever it is, I'm expecting large-scale boycotts/strikes to kick off as a result of it, alongside AI's lack of copyright protection getting exploited to troll the shit out of Disney.
More AI generated shite from Ireland: Transport for Ireland decided, for some reason, to use AI for its Hallowe'en themed ads. This was roundly complained about online. Then someone decided, for genius reasons, to ring Liveline and complain about it.
For those who are unfamiliar, Liveline is a national phone-in show presented by JOEEEE DUFFY, who could start a fight with a brick wall. Every episode is about either a petty grievance or a real horror story. It's like a national whinge-in. I am going to listen to the episode (available here) and see if there are any highlights.
All nonfiction writers can end up writing incorrect or controversial things, but why does every Gladwell book push half-formed and inaccurate theories? For years, my loose feeling about Gladwell was that he writes like someone who doesn’t care about being correct, which is not a way I would describe any other author I've encountered. There is something uniquely odd about his work.
In other news, I have my own as well called Borkfan, absolutely not a ban fork due to my having threatened multiple people, but instead dedicated to the idea that a technology that lacks chud approval must necessarily not be in the true hacker spirit.
I don't think there's a hell of a lot there that we don't already know and discuss at length, but it's cool to see Abby Thorne's new video at Philosophy Tube get into surveillance capitalism, neo-reaction/tech fascism, and how much of the discussion historically on and around social media misses the point.
It might be a decent overview reference for anyone in your life who isn't in as deep as we are, since you could do much worse in ~40 minutes.
A trend on Reddit that sees Londoners giving false restaurant recommendations in order to keep their favorites clear of tourists and social media influencers highlights the inherent flaws of Google Search’s reliance on Reddit and Google's AI Overview.
Anyways, personal sidenote:
Beyond putting another blow to AI's reliability, this will probably also make the public more wary of user-generated material - its hard to trust something if you know the masses could be actively manipulating you.
A little context: Collier has like 5 grammies, and is an incredibly creative artist that is able to take ideas and influence from disparate sources and synthesise something interesting (it’s not always good though…). Likely the greatest musician of his generation!
I don’t want to catastrophise too much here but I’m not looking forward to this being used as a cudgel from the promptfondlers.
The only open question I think is: to what extent is the music generation autoplag? (My guess, 100%)
Not a sneer, but perhaps interesting even if less so as we are focusing a bit less here on the Rationalists. Twitter thread on race science bullshit popularized on the various Rationalism extended forums.
An old and powerful force has entered the fraught debate over generative AI in schools: litigious parents angry that their child may not be accepted into a prestigious university.
Australian post-industrial is my favorite genre atm thanks to David, and I have a recommendation: https://moose-mouse.bandcamp.com/album/oxide
an Australian kid that plays drums in restaurants around Melbourne and has produced delightful solo electronic albums.
Now, I'm way too much of a fan of sidenotes, so I'll whip one out:
Beyond simple content theft being publicly lambasted, I suspect that even licensed use of artists' work for gen-AI will ignite some controversy - if Eagan Tilghman's run-in with controversy last year is any indication, any usage of gen-AI, regardless of context, will be met with hostility.
I was reminded of a particular anecdote I need to get out of my system.
There was a time on a particular fiction series' fan forum's IRC channel when I had to convince a very enthusiastic teenage fan that the instructions they found on 4chan to open a portal to a parallel world of that particular work of fantasy fiction was actually a method for synthesizing and inhaling poison gas.
The weird part was that they admitted they knew it was probably just a cruel prank, but were still willing to try just in case it was real. We had to actually find and link articles where the same reaction was exhibited as an actual documented suicide method, if an unreliable one at that, to convince them not to go for it.
By my estimate that person was about high school age, almost certainly over 13 and probably over 15. Mostly their behavior seemed normal for the age, certainly overenthusiastic about the fandom and with obvious signs of teenage ennui, but both of those are typical for someone in their mid-teens. It was just this strange incident of extreme gullibility and self-destructive devotion to a fandom that really stuck with me.