I tried to use Bard to write some code the other day, and found it amusing that it doesn't just make shit up that doesn't exist, it makes up the excuses as well when you call it out on it's bullshit.
Like you tell it a particular class doesn't exist, and it pulls an old version of the compiler out of it's arse and tells you it was deprecated in that.
AI doesn't know where it's limits are. It's incapable of saying "I don't know". They have invented a digital politician.
Reminds me of the alphastar AI that played starcraft 2. It was probably at the low grandmaster level, but a big problem with it was it didn't know when to just say "GG" and quit. It would just start doing random shit and a human on the alphastar team would have to intervene and end the match.
It takes actual intelligence to know when you're out of ideas, which these so-called AIs are lacking.