Technology @lemmy.world jeffw @lemmy.world 1 mo. ago

OopsGPT - OpenAI just announced a new search tool. Its demo already got something wrong.

www.theatlantic.com OopsGPT

OpenAI just announced a new search tool. Its demo already got something wrong.

30 comments

The hallucinations will continue until the training data is absolutely perfect
- That's not correct btw. AI is supposed to be creative and come up with new text/images/ideas. Even with perfect training data. That creativity means creativity. We want it to come up with new text out of thin air. And perfect training data is not going to change anything about it. We'd need to remove the ability to generate fictional stories and lots of other answers, too. Or come up with an entirely different approach.
  
  AI isn't supposed to be creative, it's isn't even capable of that. It's meant to min/max it's evaluation criterion against a test dataset
  
  It does this by regurgitating the training data associated with a given input as closely as possible
- In order to get perfect training data, they cannot use any human output.
  
  I'm afraid it is not going to happen anytime soon :)
  
  What other output do you propose?
  
  I've started editing my answers/questions on StackExchange. Few characters at a time. I'm doing my part.
- Most improvements in machine learning has been made by increasing the data (and by using models that can generalize larger data better).
  
  Perfect data isn’t needed as the errors will “even out”. Although now there’s the problem that most new content on the Internet is low quality AI garbage.
  
  Perfect data isn’t needed as the errors will “even out”.
  
  That is an assumption.
  
  I do not think that it is a correct assumption.
  
  now there’s the problem that most new content on the Internet is low quality AI garbage.
  
  This reminds me about a recommendation from some philosopher - I forgot who it was - he said that you should read only such books that are at least 100 years old.
- Hallucinations are an unavoidable part of LLMs, and are just as present in the human mind. Training data isn’t the issue. The issue is that the design of the systems that leverage LLMs uses them to do more than they should be doing.
  
  I don’t think that anything short of being able to validate an LLM’s output without running it through another LLM will be able to fully prevent hallucinations.
And yet people still use those bullshit generators and call their bullshit „hallucinations”.

We broke the internet for this.
- The internet was broke before.
me when paywalls
- https://archive.is/mC8kA
  
  👍
Permanently Deleted
- what does a web browser have to do with a search engine?
  
  Edge comes pre-enabled with a ton of microsoft's crappy AI - Bing chat, copilot, etc.
  
  Permanently Deleted

You've viewed 30 comments.