“The problem is not just that they dispense inappropriate advice but that people trust and prefer AI more when the chatbots are justifying their convictions.”
It’s called ‘confirmation bias’.
My own personal feeling about AI is that I always got along without it & still prefer it that way. Too many objectional issues with it.