Congressional representation is based on the number of people, not citizens. You’d need a constitutional amendment to change that.
That is madness. Common sense must be applied here, w/o an amendment. You can’t be a visitor or an intruder, and count!