Mormons will want change. Muslims who marry girls under our legal age will want change. And what will we say? "Sorry, gays can but you can't."
This won't satisfy your friends, by the way. They'll squeal "You're comparing me with bigamists and pedophiles??" All you can do is give them an affronted look and gasp, "Are you calling Muslims pedophiles???"
oops