Yes. It controversial among the other Jews. A historical case seems possible that they were Jewish in history and religion. At least for parts of their history. Though definitely rejected by the Temple Jews.
Unfortunately, some people use the Bible as a general Encyclopedia. While it has historical veracity to some extent, the Bible is not an unbiased historical source by any means, nor for that matter an accurate scientific source.
Fact is, anyone who did not conform to the Hebrew traditions was to be eliminated. Those were the days of political uncorrectness, racism and prejudice and cruelty unbound. Tribal societies are like that. Either you are a member of the tirbe or you are ready for slaugher. The enemies of Israleites were no better.
Samaritans, Phoenicians and Canaanites are Semites, which means their origin is the same as that of the Jews. Their language is simialr, and even their script is related (Hebrew alphabet came from Phoenician alphabet).
Getting to the truth about history by only using the Bible is like trying to drink your soup with a fork.