The Pentagon over in Arlington was built during the first years of WWII to house the vastly expanding War Department.
The previous War Dept building is probably the Old Executive Office Building across from the White House. Tiny by comparison.