Fortunately I never acquired that bad habit -- never over the past 15 months -- so it's not a problem. Just keep going maskless ... you're helping weak people little by little ... but it'll take time.
Me, either. I wore a mask the absolutely least possible time — only when entering a store or barbershop. I’d put it on after entering and rip it off after checking out.
I got harassed twice, both times in the great outdoors, once by a woman and once by a man. I basically told both to butt out.
Two of my kids in their mid and early were maybe the worst, constantly haranguing me to put the mask on. I did put it on now and then for family harmony.