Nope to you. It's supposed to be "the whole number of persons in each state" (U.S. Const., Amend XIV, sec. 2). The Fourteenth Amendment uses the word "citizens" lots of times, but not when it's saying who gets counted for apportionment.
Arguable. Especially since the Census determines the number of House seats & Electoral College votes. Here’s a good article on it from 2019:
https://constitutioncenter.org/blog/does-the-census-actually-count-everyone-and-should-it