“I’m glad to hear you weren’t yelling at me.”
Okay.
“It’s unfortunate though that you felt the need to use the fact that I took it that way to use it against me in the future.”
No, it’s not unfortunate, nor did I feel a need “to use it against” you. My choice to do so is not your assumption of my supposed need to do so (which doesn’t exist). Maybe you just need to lighten up.
Since you say I was wrong in my interpretation of this comment, please do explain what you did mean.