He was not a refugee.
Jesus and His family were fleeing Jerusalem because of a threat to Jesus's life. If that isn't a refugee then what is?