Actually, I'd heard that "black Irish" was a derogatory term for Italians, who immigrated to the US after the Irish did. A mean reference to their olive complexion and the fact that they were initially as unwelcome here as the Irish were.
But then again, I didn't realize until today that there was ever any Spanish settlement of Ireland.