Since Jesus was 12 at the time of the incident at the Temple, that obviously means that Joseph died after Jesus became an adult in Jewish culture.
I don’t consider it unlikely that Jesus would have helped raise His siblings, so shipping them out would not have been necessary, although still could have happened if it were part of the culture.
That’s still just a bunch of speculation.
Completely my speculation ... that’s what novels do dontchaknow.