In hindsight it was mild compared to alternatives; the British did the same with the Acadian populations in the Maritime Provinces in Canada, and nobody even cares. Britain wouldn’t accept a permanent fifth column in territory they claimed; Spain wouldn’t either and decided they’d rather be safe than sorry.
How were the Jews of Spain a “5th Column”?