Maybe not. Didn't Yale used to be all male? Going to "First Year" is kind of British and all, not so bad as a lot of the PC academic things I read here, and elsewhere.
First years was good enough for Harry Potter!
At my alma mater, Virginia, students have always been first-year, second-year, etc., even when it was all-male (before 1970).