Some “endearments” can be very condescending.........
I am guilty of using these terms myself - usually in a nice way - and rarely to offend, but occasionally a "Bless your heart Sugar" does sneak in there.
I happened to see the video of the incident and Obama made his remark in a very condescending, dismissive way!