No, it's not. And while you're right, they left their homes because of military action, just whose military action caused them to leave?
Hint: It wasn't the Israelis!
Hey, I'm not trying to assign blame! I'm just saying that even if we disagree with the demands of the Palestinians, we can understand them somewhat. The 48 war resulted in 100s of thousands of refugees, who left jewish territory. While the Arab states certainly weren't the "victims" in the war, the refugees were expelled from Jewish held territory.
Refusal to accept that there were nasty things done by both sides is simply denial.