I think I had it a little wrong. If you were born before 1954 it applies to your spouse who can retire at 62, but it looks like it is going away.
https://www.fool.com/retirement/general/2016/03/18/social-security-news-if-youre-married-heres-how-th.aspx
I just emailed our advisor to find out if this is what he was talking about.
Thanks E.