Yankee Stadium was not built to be a football field. Taht was not what Col. Ruppert had in mind. The Giants didn’t arrive until many years later.
Prior to building Yankee Stadium, the Yankees shared the Polo Grounds with the baseball Giants. Yankee Stadium was built to take advantage of Babe Ruth.
I have been to ballgames at all three of the ballparks I mentioned. All three had deep CFs, shallow foul lines, and good power alleys. That forces you to play baseball, not Home Run Derby.