By that same reasoning, inland states such as Iowa, Vermont, Arkansas, Missouri, Kentucky, and Tennessee must have NEVER paid ANY taxes at all because they didn't have a seaport to collect them. Surely that is not what you are suggesting, is it?
No, what I'm suggesting is that if the lion's share of imports were destined for southern southern consumers then those goods would have entered through southern ports. The fact that 19 out of every 20 dollars in imports came to the North indicates that demand down south for those goods was virtually non-existent.