If this is not a Constitution issue, then there are many state issues that need to be considered.
Why should I have to pay federal gas taxes for road that I will never drive? Why should I have federal taxes taken out of my paycheck for services I will never render?
Because the primary duty of the State is to promote the common good. You can claim that these things don't serve to promote the common good if you want. I don't have any objection to either in principle.