They took Poland before we even entered the war. Had they stopped there, they probably could have kept it. According to your calculus, they would have been in the right to do so.
I don't hold with the "Might makes Right" theory of war morality.
Your entitled to your opinion.