You need to read a little deeper into your Adam Smith
His collection of data made it clear that monopolies (mercantilism) were drags on the economy.
Having larger markets spur the further division of labor not possible in small ones. This increases production and lowers prices for the consumer. Hence, the reason we have international trade.