It's always amazed me that some people find it so difficult to understand that in the case of the Holy Family, the fact that they were raising the Son of God was really the only thing that mattered. NOTHING about their family structure could be considered "normal;" in fact, the duty that God bestowed upon them is almost beyond comprehension.
Protestants subscribe, imo, to jealous egalitarianism: "no one is as good as I am. My interpretation of the Bible is as good as anyone's." Humility has no meaning. God has already chosen those who will be saved, so why be humble, right? That way, they can indulge in passions as long as they cry "Lord, Lord," they will be fine. That's part of the appeal. Someone once remarked that it is real miracle Protestantism didn't spread more than it did.
An Orthodox Nativity icon actually shows Satan telling +Joseph not to believe the Virgin Birth because "it makes no sense." I think it is a telling indication as to what the Church though of those who doubted something the Church believed all along.
In the lower corner is dejected +Joseph and an old man, satan, is seen casting doubts.