Roman leaders used to complain about all the silver that was leaving the Republic/Empire in exchange for the spices coming eastward.
They did! I remember reading that. Was it Tacitus?