Log in | Sign up @ davidagain @lemmy.world

Posts

10

Comments

1,994

Joined

1 yr. ago

This graph is really, really wrong. Properly messed up.

This is you

https://youtu.be/mkcKQmr7kRc

I already told you my experience of the crapness of LLMs and even explained why I can't share the prompt etc. You clearly weren't listening or are incapable of taking in information.

There's also all the testing done by the people talked about in the article we're discussing which you're also irrationally dismissing.

You have extreme confirmation bias.

Everything you hear that disagrees with your absurd faith in the accuracy of the extreme blagging of LLMs gets dismissed for any excuse you can come up with.

You're so insightful and wise. You have learned much from other viewpoints.

It's like you didn't listen to anything I ever said, or you discounted everything I said as fiction, but everything your dear LLM said is gospel truth in your eyes. It's utterly irrational. You have to be trolling me now.

... because this sign was made before the IBM PC was invented.

Language changes over time.

I think you're missing sarcasm for insanity, and the reason that you're doing that is that you were already belittling their viewpoint quite fiercely, rejecting absolutely everything they said just because you disagree with their conclusion.

it’s so good at parsing text and documents, summarizing

No. Not when it matters. It makes stuff up. The less you carefully check every single fucking thing it says, the more likely you are to believe some lies it subtly slipped in as it went along. If truth doesn't matter, go ahead and use LLMs.

If you just want some ideas that you're going to sift through, independently verify and check for yourself with extreme skepticism as if Donald Trump were telling you how to achieve world peace, great, you're using LLMs effectively.

But if you're trusting it, you're doing it very, very wrong and you're going to get humiliated because other people are going to catch you out in repeating an LLM's bullshit.

Has lots of experience starting things, yet doesn't look old. Hmmm.

I have a similar story, but it got worse and worse with the lies as it got through the table. I fought it for an hour, then I wrote a script instead.

You're better off asking one human to do the same task ten times. Humans get better and faster at things as they go along. Always slower than an LLM, but LLMs get more and more likely to veer off on some flight of fancy, further and further from reality, the more it says to you. The chances of it staying factual in the long term are really low.

It's a born bullshitter. It knows a little about a lot, but it has no clue what's real and what's made up, or it doesn't care.

If you want some text quickly, that sounds right, but you genuinely don't care whether it is right at all, go for it, use an LLM. It'll be great at that.

I would be in breach of contract to tell you the details. How about you just stop trying to blame me for the clear and obvious lies that the LLM churned out and start believing that LLMs ARE are strikingly fallible, because, buddy, you have your head so far in the sand on this issue it's weird.

The solution to the problem was to realise that an LLM cannot be trusted for accuracy even if the first few results are completely accurate, the bullshit well creep in. Don't trust the LLM. Check every fucking thing.

In the end I wrote a quick script that broke the input up on tab characters and wrote the sentence. That's how formulaic it was. I regretted deeply trying to get an LLM to use data.

The frustrating thing is that it is clearly capable of doing the task some of the time, but drifting off into FANTASY is its strong suit, and it doesn't matter how firmly or how often you ask it to be accurate or use the input carefully. It's going to lie to you before long. It's an LLM. Bullshitting is what it does. Get it to do ONE THING only, then check the fuck out of its answer. Don't trust it to tell you the truth any more than you would trust Donald J Trump to.

Yep. UK.

Shit.

The really upsetting thing about this for me is that I can't tell without clicking through whether it's the USA or UK, and I suspect it's the UK.

How can I subscribe to piefed.world users and communities etc from my lemmy.world account?

How do I subscribe to a user or community on piefed.world and see it in my lemmy.world feed?

Whereas if you ask a human to do the same thing ten times, the probability that they get all ten right is astronomically higher than 0.0000059049.

I agree it was a dumb comparison to start off with.

I wasn't the one who made it, but the license issue is the logical conclusion if OP insists on the comparison.