The artisans and craftsmen of the late 18th century were all white. Slaves may have driven the wagons to the construction site and unloaded them but white people built the white house and everything else during that time period.
Exactly and it even states on the whitehouse.gov website. It showed one white man had 3 black spaces trained in masonry. But, that was it.