I don’t think all of your military pay is exempt from federal income tax either. (And Romney was obviously not talking about active duty military personnel.)
I was going to ask when they changed that. We paid taxes on my husband’s salary when he served. The only part that wasn’t taxed was the housing allowance.