As a mushroom picker this thing right here was my first big issue with the AI grift. It doesn't take a tech bro to understand how these models cannot actually give advice on anything because they make no decisions.
There was a really inreresting study locally on the heuristics of mushroom picking, turns out it's one of the riskiest foraging things we humans do and one where we have culturally developed very efficient and well working precautionary principles. It is a pretty perfect example of how an AI model is not intelligent in any way.
i will never forage for a mushroom because I will never be more than 99% sure it's something that's fine and that 1% is "your organs melt and you pee them out" levels of "not fine"