Not non-religious just non Christian. Most libertarians I know seem to like that unknown god that they foolishly worship.
Christian libertarianism describes the synthesis of Christian beliefs concerning free will, human nature, and God-given inalienable rights with libertarian political philosophy. It is also an ideology to the extent its supporters promote their cause to others and join together as a movement. In contrast to the Christian left and the Christian right respectively, they believe that charity and enforcement of personal-level morality should be the purview of the (voluntary) church and not the state. These responsibilities must not be abrogated, though any non-governmental organization (NGO) not publicly financed is free to pursue them as well.
And there is also Libertarian Christianity:
Libertarian Christianity is a facet of Christian theology. Its advocates believe that it is the most biblically, rationally, and practically correct legal and political philosophy. This type of libertarianism derives from a specific blending of systematic theology and biblical theology.[1] Advocates claim to be Christians first, and libertarians second. As libertarians they believe that all secular governments exist to protect natural rights, and only to protect natural rights; and they believe that natural rights are necessarily defined in terms of private property, at least in the legal and political arena. --- Although they readily acknowledge the distinction between their legal / political philosophy and the rest of their theology, they are suspicious of any attempt at separating the two, because separating the two leaves the visible Church without a viable, Bible-based legal philosophy.Libertarian Christians claim to be distinct from secular libertarians and Christian libertarians. They claim to be distinct from secular libertarians by deriving their libertarian legal and political philosophy from the Bible, rather than from secular sources. They claim to be distinct from Christian libertarians through their derivation of Bible-based legal philosophy using biblical hermeneutics that are different from those used by Christian libertarians.[2]
Neither of which I have ever heard of.