So when Bob Dylan was singing about refuge from the storm, he wasn't talking about providing a safe place for someone who needed it.
Bob Dylan doesn't meet my requirements for a philosopher, I'd put him in the same class as the yellow journalists. They both will write whatever they feel will sell, and they both have political agendas fueling their writings. In fact, Dylan is so lost he keeps bouncing from one religion to another like a pin ball, with atheism in between just for variety. He sought refuge from the storm of his own life in a syringe full of heroin.
Providing a safe place for someone who needs it doesn't make one a refugee. Many, many people relocate to seek refuge from danger, from leaving the urban jungle after umpteen muggings to packing up and moving far away from an earthquake prone region. Are they refugees too?
I think the refugees, say, in the Sudan, who are fleeing from genocide into neighboring countries who do not want them might strongly disagree with you and Bob Dylan about who or what is a refugee.