Skip Navigation

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds

finance.yahoo.com Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds

The chatbot gave wildly different answers to the same math problem, with one version of ChatGPT even refusing to show how it came to its conclusion.

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds

"The chatbot gave wildly different answers to the same math problem, with one version of ChatGPT even refusing to show how it came to its conclusion."

It's getting worse. And because it's a black box model they don't know why. The computer science professor here likens it to how human students make mistakes... but human students make mistakes because they don't have perfect recall, mishear things being told to them, are tired and/or not paying attention... A bunch of reason that basically relate to having a human body that needs food, rest and water. A thing a computer does not have.

The only reason ChatGPT should be getting math wrong is that it's getting inputs that are wrong, but without view into it they can't figure out where it's getting it wrong and who told it the wrong info.

39

You're viewing a single thread.

39 comments
You've viewed 39 comments.