Your problem is that the Constitution apportions the House based on the number of PERSONS.
Whatever SHOULD be, the counting of PERSONS is what is the law.
Yes, the 14th Amendment would need to be revised.