The portrait of George over the fireplace mantle appears to be frowning.
Sargent said Washington was stone-faced, did not engage in any small talk with the artist. CSPAN had a good show about it on American History TV this weekend.