That’s not too surprising. The models are built to to find patterns. So on-task for this problem. But humans hallucinate connections all the time - ever heard of Alex Jones? That’s what you’re mostly seeing in what you’re reporting regarding poor AI performance. Hallucinations. Humans are still better at recognizing when they’ve made an unrealistic connection (well most). - but we make the connection in the first place, then correct ourselves.
Right now (and for all time, I would presume), *you* are the gut-check on AI result to call BS. I know that when I see BS in an AI result I tell it to the AI, and I often get a much better answer back.
I should also add, that’s why - when I share something I got out of an AI - I usually share my prompts as well. Because, as Lily Jay has shown, you can “trick” some AIs into saying almost anything you want.
I liken it to a REALLY bright child. They can figure so much out - but they are still so naïve and so easily deceived.