It's always wise to avoid correcting other people's grammar unless you're sure you're right.
In this case, you were wrong. The preposition "to" requires the objective case of the noun. Thus it is correct to say "to apologize to me" or "to apologize to me and my wife."
There's nothing wrong with grammar police...unless they don't know their grammar.
Yes, in this case I was wrong and ended up looking like a boorish nag. That's normally your territory.