Yes, its the angle. Look again to the far right side of the frame from Gowdy. (Gowdy's left side). You will see the edges of an arm. To me . . . same skin tone and suit sleeve.
No one is disputing that the man was sitting behind Gowdy. The question is . . . who is he?