It was JUDEA, a province of Israel when Jesus was born there. Even the Romans called it Judea (from Judah, son of Jacob, and source of the name "Jews" ).
Just because Muslim armies occupied it 1800 years later doesn't make it any less Israel or Jewish land. Muslim armies also invaded and conquered Spain, occupying it for 770 years before it was also liberated. Neither land has any importance in Islam.
Once land is conquered by Islam, muslims will tell you that it is muslim territory for eternity.
It was the Roman province of Judea up until AD 130.
After the Bar Kokhba revolt Rome wanted to strip the region of its Jewish identity and they renamed it Syria Palaestina.