Nice now i've read a post about an article about a paper by goldman-sachs, see you later if i find the original paper, otherwise there's nothing really to discuss.
Ok first of all it's not a peer-reviewed paper, it's a report. Words fucking matter.
Okay, yes true. But have you considered that Big Number Go Up? Do you really want to miss the boat on this massive speculative opportunity?
AI will get better
Aren't LLM already pretty much out of (past) training data? Like, they've already chewed through Reddit/Facebook etc and are now caught up to current posts. Of course people will continue talking online and they'll continue to use it to train AI. But if devouring decades of human data, basically everything online, resulted in models that hallucinate, lie to use, and regurgitate troll posts, how can it reach the exponential improvement they promise us!? It already has all the data, has been trained on it, and the average person still sees no value in it...
Your mistake is in thinking AI is giving incorrect responses. What if we simply change our definition of correctness and apply the rubric that whatever AI creates must be superior to human work product? What if we just assume AI is right and work backwards from there?
Then AI is actually perfect and the best thing to feed AI as training data is more AI output. That's the next logical step forward. Eventually, we won't even need humans. We'll just have perfect machines perfectly executing perfection.
My wife works for a hospital system and they now interact with a chat bot. Somehow it's HIPAA compliant, I dunno. But I said to her, all it's doing is learning the functions of you and your coworkers, and it will eventually figure out how to streamline your position. So theres more to learn, but it's moved into private sectors too.
If AI is a trillion dollar investment, what trillion dollar problem is it solving?
Why, the trillion dollars not yet in the pockets of the companies that think they can take advantage of AI of course.
The naked truth is that #4 answers #1. The biggest utility AI might provide would be replacing paid workers. That's a trillion dollar problem if your ultimate goal is to hoard wealth and sit atop the highest pile of gold like a dragon.
So again, we have a solution to a problem only the wealthy elite have, being marketed as an advancement for the greater good of society, to justify stealing the massive resources it consumes, in order to not have to pay that directly to their workers.
Capitalism.
Use it to replace Congress, SCOTUS, POTUS, CEOs, Executives, Judges. Fair and impartial. And cheaper.
I like to read AI as Al (i.e. Allen) and pretend he's just some guy stealing ideas, lying, and generally fucking up at his job. Al is an asshole
Weird Als Twitter account is worth a read: https://x.com/alyankovic/status/1670113967497433090?lang=en
Yeah this is basically Metaverse or NFTs but with a slightly more plausible use case so that it will drag out far longer before corporations quietly pretend it never happened.
It has been proven to solve scientific problems were math models are difficult to implement. But those niche cases. Forget about AGI
The tech itself is decent. But as always, profit above anything else, so we can't have anything nice.
So instead, it will be wasted and forgotten.
It will not be wasted or forgotten. The cat's out of the bag. You can run it locally on your machine. It can summarize text for you, it can help you write boilerplate code, it can help you find that file with that thing that you don't quite remember, it can create a poem about your left nut. The tech already has proven useful, it's about where you use it.
Ok but point 4 is a bit too based for GS.
Tho I have been arguing that at some point ("voluntary") consumption just collapses over average sentiment. Eg over bad living and working conditions, or just a hopelessly depressive environment (like, I don't wanna buy slave chocolate).Unfortunately, as Keynes noted: “Markets can remain irrational longer than you can remain solvent”
And my god, they’re committed to irrationality right now.
Nvidia has to be the most obvious thing to short in this whole mess, except for that quote. If the AI bubble popped tomorrow, you'll make a lot of money. If it pops in a year, you may lose it all before then.
To be fair, I watched a ton of crypto bros use that quote to justify holding shitcoins while they crashed to zero.
What trillion dollar problem is it solving? In the minds of investors, that “problem” is paying people for labor.
Even when the same people need to get money from people they don't wanna pay (or there aren't any buyers), this is still the case.
So if GDP doesn't come from nature (which it shouldn't, at least net shouldn't), the system cannot work with financial wealth being the only goal.
But it can work long enough to destroy much of everything everywhere.
You have a tl;dr of this?
Edit: this was supposed to be a joke.
I can summarise it with AI:
Ed Zitron, a tech beat reporter, criticizes a recent paper from Goldman Sachs, calling AI a "grift." The article raises questions about the investment, the problem it solves, and the promise of AI getting better. It debunks misconceptions about AI, pointing out that AI has not been developed over decades and the American power grid cannot handle the load required for AI. The article also highlights that AI is not capable of replacing humans and that AI models use the same training data, making them a standstill for innovation.
Ed Zitron, a tech beat reporter, criticizes a recent paper from Goldman Sachs, calling AI a "grift."
Fittingly, this paragraph is incomprehensible to anyone who hasn't already read the blog post; who is calling AI a grift, Zitron or GS? And is Zitron critical of the GS article (no, he's not)?
Now, if it was your job to actually absorb the information in this blog post, there's really no way around actually reading the thing - at least if you wanna do a good job. Any "productivity boost" would sacrifice quality of output.
Seriously? It'll take you a minute to read, if you read slowly.
This IS the tl;dr of the article first off, and second, just read the top "paragraph" (in quotes because it's only like 2 sentences). It's basically the tldr of the tldr
Number 3 drives me hair-tearing insane, I have straight up seen AI cultists say AI will fix the power grid but only if we keep pouring resources into it so that it can fix all our problems. ಠ_ಠ
Bitcoiners make similar arguments about using energy being "good for the system"
e/acc. The dumb MFs believe burning fossil fuels as fast as possible will lead to technological advancements to mitigate the problems. It's all wishful thinking and convienant blind faith.
“I’ll finally have he strength to kick this heroin habit if I just do more heroin.”
"we should all do heroin to support the habit and mainstream it." - every fucking company pushing AI onto society when it's dangerous, janky af and ridiculously expensive.
That is, entirely unironically, how deep addiction makes you think. Just need enough to get to normal...
I'm very confident that with carte blanche the electrical engineers already overseeing the grid could solve the problems it faces. We don't need an ai miracle, we need to remove bureaucratic and funding obstacles for critical infrastructure.
That's what Altman himself claims.
I love that Ed Zitron is getting more popular. He is on a ferocious rampage against the rot economy and I'm all here for it.
Maybe he should buy Red Lobster, force them into unfavorable contracts for supplies, sell out their land from under them, and lease the land back to them about it.
And this absolutely will not change the course of AI investment whatsoever because it still driving a huge amount of profit.
The only thing that will finally change the course of AI investment is when the bubble finally burst which will cause the collapse of our economy because, by that point, so much money will have been invested in it. There will be no other possible result.
And why? Because these assholes only care about one thing: short term results at any cost.
The only thing that will finally change the course of AI investment is when the bubble finally burst which will cause the collapse of our economy because, by that point, so much money will have been invested in it.
We're not there yet. Remember, tech is not the whole of the economy. The recent tech layoffs have had Silicon Valley screaming, "The sky is falling!!" and the rest of the planet going "huh? You guys hear something? Must've been a fly"
Too big to fail, too big even to jail - it's worked before, they seem to be counting on it working once more.
But I could be giving them too much credit - perhaps they really do believe in it.
What's failing or jailing?
Like, I'm not defending AI here but using a lot of power, and building software tools people buy is not illegal.
We can argue it's a bit of a scam in the sense that many objectives purported are not accomplished, but that's a tale as old of time with software.
We can also argue the copyright issue, I think that's the most relevant topic.
But in general this is just software 2024 MEGA EDITION. Everything sucks, everything is just executives moving money around.
You think it's too big to fail now, wait until they start wondering what they built all of those extra data centers for.
“profit” is gonna need some qualifiers there.
Firing the staff & reporting “earnings”? Goosed stock price on the above + hypey garbage? Enforced “features” no one wants? AI hardware makers? Okay, that one’s legit, but ironically not AI.
I wish i knew of a good way to profit off of this bubble. I could work for a company in the AI space, but I think it would be well above my “executives hyping the smell of their own farts” threshold. And shorting Google and Microsoft is a dangerous game.
You got me thinking a bit on this one. One possibility is if you want to make a bet on it failing to deliver value in the near future, look at the companies whose stock prices have fallen on the fear of AI putting them out of business. For example, Concentrix does call center outsourcing and their stock is down significantly from their 2022 peak, partially on the expectation that AI is going to take business from them. Now, their profit margin is tiny and they don't seem to be growing much, so I don't know that they are a great investment, but there could be upside if the negative cloud of AI is removed. There are probably better examples out there, this one just came to mind.
Note: I have not done any research on this idea or on Concentrix and don't know if this is a good idea, but at least less risky than shorting the AI hype.
If you knew of a good way, you probably already would be.
Also, you probably wouldn’t have a soul
If AI is a trillion dollar investment, what trillion dollar problem is it solving?
If you could increase the productivity of knowledge-workers 5%, that's worth a trillion
- AI won't work because of the American power grid
Makes no sense. Why would one random country having an underdeveloped power grid stymie AI?
I'm not an AI gal, but those are obvious bad points.
If you could increase the productivity of knowledge-workers 5%, that's worth a trillion
A big if (and where does these numbers come from?), but more importantly, a "more productive" knowledge worker isn't necessarily a good thing if the output is less reliable, interesting or innovative for example. 10 shitty articles instead of 1 quality article is useless if the knowledge is actually worth anything to the end user.
I question more that smartphones and especially the internet had roadmaps. was the roadmap for the military to pass it to education to be taken up by companies and transform it from text to gui then use algorithms to take advanatage of human psychology???
I think number 2 is a fairly good point.
Qualitatively, there were huge leaps made between 2018 and 2020. Then it's been maybe a shade better but not really that much better than 3 years ago. Certainly are finding ways to apply it more broadly and more broad ecosystem of providers catching up to each other, but the end game is mostly more ways to get to roughly the same experience you could get in 2021.
Meanwhile, people deep in the field go "but look at this obscure quantitative measure of "AI" capability that's been going up this whole time, which show a continuation of the improvement we saw from 2018". Generally, the correlation between those values and the qualitative experience tracked during those early years, but since then qualitative has kind of stalled and the measures go up. Problem is the utility lies in the qualitative experience.
2 and 3 are both posing questions
-
How could AI even be applied?!?!?
-
How could AI even be improved?!?!?
as though the implication were that these are unanswerable questions
when they're actually easily answerable
2: it can be applied to logistics, control of fusion energy, drug-discovery pipelines, lots of things that could soon amount to a trillion dollars
3: it can be improved by combining LLMs with neural-symbolic logic and lots of other things extensively written about
I assume the Goldman Sachs report is more intelligent than this summary makes out. Coz the summary is just saying we should throw our hands up in despair at well-studied questions that a lot of work has gone into answering.
-
the first two computers were connected in 1969 leading to arpanet. I would say the qualitative experience took quite some time to improve. The type of algorithms ai has evloved from I would say came out of the 2000's maybe late 90's. Taking google as sorta a baseline maybe. I would say we are equivalent now to about mid nineties internet wise so it will be interesting to say the least on where this goes. They do use to much energy though and I hope they can bring this down maybe with hardware acceleration.
I feel like #3 shows up for every tech innovation. I remember people bitching about the Internet not being viable because phone lines were too slow. The demand needs to be there before the infrastructure will get built.
Some difference in that fixing the power capacity problem will absolutely mean combusting more hydrocarbons in practical terms, something we can ill afford to do right now. Until we get our legs under us with non carbon based energy generation, we should at least not take on huge power burdens.
Now there was an alleged breakthrough that might make LLMs less energy hogs but I haven't seen it discussed much to know if it is promising or a bust. Either way power efficiency might come as a way to save #3.
The trillion dollar problem is paying billions of pesky workers to work
I think that's the obvious implication of this question, but you're missing the implied question arising from that answer: is this a problem we want to solve in this way ?
Yes? But it's the same problem as all automation - the majority of the surplus goes to the business owner, not the workers.
In a better society, we'd be saying "hooray, now I'll have more free time!"
Obvi
The last part is wrong. They aren’t imagining improvement. They know this is it for now and they’re lying their asses off to pretend that they’ll be able to keep improving it when there’s no training data left. The grift is all that’s left.
Wait until these models start to poison themselves by consuming their own generated content...
Link to the article please?
Commenting to save this for later
No, not the research, the article they're referring to by the tech reporter. But thank you.
Edit: This is the article: https://www.wheresyoured.at/pop-culture/
Haven't found the specific article yet, but I believe this is his site. I'll keep looking, but this should be a good start.
Edit: I'm big dumb. It looks like it's the first one on the list.
Thanks, I appreciate it.
Also, since the title of the article is "Pop Culture," I'm not surprised you missed it. Direct link: https://www.wheresyoured.at/pop-culture/
Edit: Holy shit, read this article! Don't just do the TL;DR.
Point 2 and 3 are legit, especially the part about not having a roadmap, a lot of what's going on is pure improvisation at this point and trying different things to see what sticks. The grid is a problem but fixing it is long over due. In any case, these companies will just build their own if the government can't get its head out of it's ass and start fixing the problem (Microsoft is already doing this).
The last two point specifically point to this person being someone that doesn't know the technology just like what they are accusing others of being.
It's already replacing people. You don't need it to do all the work, it will still bring about layoffs if it gives the ability for one person to do the job of 5. It's already affecting jobs like concept artist and every website that used to have someone at the end of their chat app now has an LLM. This is also only the start, it's the equivalent of people thinking computers won't affect the workforce in the early 90s. It won't hold up for long.
The data point is also quit a bold statement. Anyone keeping abreast with the technology knows that it's now about curating the datasets and not augmenting them. There's also a paper that comes out everyday about new training strategies which is helping a lot more than a few extra shit posts from Reddit.
Feels like you're missing the point of the fourth bulletpoint. What they are saying, is not that AI is not taking people's jobs, only that true potential comes from real humans that provide some quality that AI is not capable of truly replacing. It is being used to replace people with it's inferior imitations.
Not that your point is invalid, it absolutely is a valid and valuable criticism itself.
these are all dumb
Ok!
In what way, may I ask?
Not the original poster, but here I go:
-
The investment is the increase in progress of technology. It will develop faster and more efficient. In all sectors.
-
AI will improve because of its capability to help programmers in order to develop itself.
-
AI is being misused for all kinds of vain projects at the moment. But once the shine wears off people will go jump on the new bandwagon. By limiting use to the things that actually improve through AI, we can stabilise the energy requirement. But I agree we are not there yet.
-
AI is not going to replace jobs. Why would a company fire people when they could just use AI to multiply that particular teams productivity and make more money? Some c-suits do not understand this yet, but they will eventually.
-
Because of copyright, they all need to use non-copyrighted material. Which in this timeline is very far and few between. They will find other ways to improve AI, data feeding is the easiest way but not the only one. I suspect the next innovation will be data refining. Imagine an LLM only trained on scientific papers.
LLMs are only the first step into creating AGI. We are teaching the computer to be able to communicate with us in a meaningful manner. The intelligence will come after.
It is like teaching a baby to talk. Yes it will say dumb shit, but it will improve over time.
-
