How do you know Joseph was dead? Scripture doesn't say he died. Maybe he was assumed into Heaven.
The apostles told their disciples who told their disciples who....
This is what Christian tradition is: oral histories of the parts that weren't felt to be central enough to be in the Gospels.
You are free not to believe these oral histories. But to assume that because something that isn't in the Bible is untrue runs counter to logic.
Misfire on the text entry. You get the idea.