I checked a couple of on-line dictionaries. The use of the word "gender" to refer to physical traits is correct.
2. either the male or female division of a species, especially as differentiated by social and cultural roles and behavior:
the feminine gender.
Compare sex (def 1).
2 a: sex < the feminine gender >
b: the behavioral, cultural, or psychological traits typically associated with one sex
This is the dumbing down of the language. Until very recently gender was never used to refer to maleness or femaleness of a human being. My sex is male. The word male has a masculine gender.
Further evidence of the dumbing down is that you think the word sex is a verb. It is not. You do not sex. You have sexual intercourse.
Referring to new edition of a dictionary only proves my point.