This is a word I always get wrong. I just have a different meaning for it in my head.
I always think it means: standoffish, due to not caring.
I've made that same mistake, confusing "diffident" with "indifferent."
Me too.