Not necessarily. Although Jesus got all his human DNA from Mary, every human being carries genetic material that is not physically expressed in that person. Jesus could have had features more like his grandfather's than his mother's, or more like his great-grandmother's.
Given the endogamous nature of their society, there might not have been a great deal of possible variation - blue eyes and blond hair not likely! - but there would be some, even without the additional genetic material of a human father.
Good point.
You both make valid points which naturally raises the question ... who did Adam resemble ;-)